-- Logs begin at Mon 2022-01-31 03:50:25 UTC, end at Mon 2022-01-31 05:11:27 UTC. -- Jan 31 04:36:29.705701 dv-cinder-826608-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 31 04:36:29.716150 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 31 04:36:29 2022] *** Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: nodename: dv-cinder-826608-2-iscsi Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: machine: x86_64 Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: clock source: unix Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: pcre jit disabled Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: detected number of CPU cores: 4 Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: current working directory: / Jan 31 04:36:29.718062 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: detected binary path: /usr/bin/uwsgi-core Jan 31 04:36:29.718754 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: your processes number limit is 47680 Jan 31 04:36:29.718754 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: your memory page size is 4096 bytes Jan 31 04:36:29.718754 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: detected max file descriptor number: 2048 Jan 31 04:36:29.718754 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: lock engine: pthread robust mutexes Jan 31 04:36:29.718754 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: thunder lock: enabled Jan 31 04:36:29.718754 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 31 04:36:29.718754 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 31 04:36:29.763831 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: Python main interpreter initialized at 0x55d9c59b59c0 Jan 31 04:36:29.763831 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: python threads support enabled Jan 31 04:36:29.763831 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: your server socket listen backlog is limited to 100 connections Jan 31 04:36:29.763831 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: your mercy for graceful operations on workers is 90 seconds Jan 31 04:36:29.764163 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: mapped 403077 bytes (393 KB) for 2 cores Jan 31 04:36:29.764247 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: *** Operational MODE: preforking *** Jan 31 04:36:29.764483 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: *** uWSGI is running in multiple interpreter mode *** Jan 31 04:36:29.764483 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: spawned uWSGI master process (pid: 108855) Jan 31 04:36:29.764667 dv-cinder-826608-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 31 04:36:29.765196 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: spawned uWSGI worker 1 (pid: 108856, cores: 1) Jan 31 04:36:29.765546 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: spawned uWSGI worker 2 (pid: 108857, cores: 1) Jan 31 04:36:29.765695 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 31 04:36:31.560224 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:36:31.560224 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: from cryptography.utils import int_from_bytes Jan 31 04:36:31.560888 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:36:31.560888 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: from cryptography.utils import int_from_bytes Jan 31 04:36:31.563616 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:36:31.563616 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: from cryptography.utils import int_from_bytes Jan 31 04:36:31.564142 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:36:31.564142 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: from cryptography.utils import int_from_bytes Jan 31 04:36:34.163294 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 04:36:34.163904 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 04:36:34.164039 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 04:36:34.164393 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 04:36:34.164490 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 04:36:34.164869 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 04:36:34.164967 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 04:36:34.165056 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.165231 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 04:36:34.165326 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.165596 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 04:36:34.165682 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.165857 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 04:36:34.165950 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.166246 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.166332 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.166553 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.166651 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.166923 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.167099 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.167250 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.167373 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.167572 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.167741 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.167825 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.167909 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.168130 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.168231 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.168452 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-2-iscsi {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.168547 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.168773 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.168872 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.169071 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.169171 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.169378 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.169464 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.169695 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.169781 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-2-iscsi {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.169998 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.170096 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.170317 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.170401 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.170619 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.170709 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.170967 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.171145 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.171279 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.171597 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.171710 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.171905 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.172029 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.172216 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.172414 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.172544 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.172735 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.172842 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.173046 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.173143 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.173359 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.173443 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.173698 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.173793 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.174017 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.174114 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.174333 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.174418 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.174647 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.174741 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-2-iscsi {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.174987 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.175076 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.175317 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.175452 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.175630 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.175716 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.176033 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-2-iscsi {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.176132 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.176352 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.176439 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.176657 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.176743 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.176972 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.177075 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.177292 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.177377 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.177601 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.177694 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.177926 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.178018 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.178244 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.178335 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.178561 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.178691 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.178901 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.178991 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.179210 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.179336 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.179519 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.179614 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.179825 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.179941 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.180147 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.180241 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.180451 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.180553 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.180754 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.180844 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.181002 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.181100 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.181307 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.181399 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.181628 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.181726 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.181948 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.182050 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.182236 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.182332 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.182542 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.182639 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.182892 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.182987 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.183210 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.183304 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.183559 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.183656 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.183825 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.183922 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.184080 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.184149 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.184385 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.184493 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.184713 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.184804 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.185030 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.185131 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.185341 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.185459 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.185649 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.185766 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.185956 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.186042 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.186267 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.186367 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.186579 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.186676 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.186912 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.187033 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.187223 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.187318 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.187542 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.187629 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.187861 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.187952 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.188177 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.188276 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.188487 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.188572 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.188809 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.188940 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.189132 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.189262 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.189440 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.189532 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.189755 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.189840 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.190079 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.190171 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.190386 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.190472 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.190693 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.190778 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.191025 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.191140 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.191345 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.191431 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.191661 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.191768 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.191973 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.192074 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.192223 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.192322 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.192524 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.192623 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.192827 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.192912 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.193145 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.193233 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.193454 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.193624 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.193756 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.193848 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.194058 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.194146 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.194358 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.194453 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.194663 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.194747 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.194992 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.195109 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.195298 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.195392 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.195601 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.195686 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.195904 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.195992 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.196206 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.196301 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.196512 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.196597 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.196816 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.196902 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.197120 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.197213 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.197428 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.197513 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.197739 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.197824 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.198042 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.198636 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.198906 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.199348 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.199490 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.199579 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.199666 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.199746 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.199823 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.199950 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.200120 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.200205 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.200432 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.200519 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.200745 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.200845 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.201071 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.201162 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.201382 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.201469 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.201695 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.201788 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.201998 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.202083 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.202303 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.202396 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.202620 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.202705 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.202942 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.203031 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.203249 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.203337 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.203560 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.203656 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.203860 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.203947 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.204164 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.204258 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.204467 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.204560 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.204770 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.204864 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.205073 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.205158 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.205377 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.205461 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.205681 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.205780 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.205983 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.206070 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.206280 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.206370 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.206589 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.206687 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.206923 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.207015 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.207230 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.207314 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.207532 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.207644 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.207838 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.207923 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.208157 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.208243 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.208468 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.208554 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.208779 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.208864 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.209092 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.209184 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.209419 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:36:34.209506 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.209750 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.209836 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.210078 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.210162 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.210395 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.210481 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.210710 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.210809 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.211055 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.211152 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.211378 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.211463 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.211688 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.211779 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.211999 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.212094 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.212309 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.212402 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.212624 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.212716 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.212938 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.213031 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.213252 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.213336 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.213571 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.213676 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.214532 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215165 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215263 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215344 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215422 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215499 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215583 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215739 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215831 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.215912 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.216038 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.216174 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.216331 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.216493 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.216671 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.216817 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.217010 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.217153 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.217323 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.217483 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.217645 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.217798 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.217957 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.218143 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.218278 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.218491 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.218585 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.218845 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.218964 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.219183 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.219296 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.219502 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.219593 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.219822 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.219906 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.220132 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.220230 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.220448 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.220540 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.220767 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.220861 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.221080 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.221172 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.221385 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.221470 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.221687 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.221771 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.221991 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.222085 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.222299 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.222384 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.222599 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.222684 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.222943 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.223033 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.223270 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.223364 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.223576 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.223684 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.223896 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.223996 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.224196 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.224281 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.224505 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.224649 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.224816 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.224902 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.225124 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.225217 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.225430 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.225529 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.225739 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.225824 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.226048 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.226178 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.226352 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.226447 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.226666 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.226750 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.227002 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.227101 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.227304 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.227401 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.227623 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.227708 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.227924 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.228009 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.228224 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.228311 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.228534 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.228631 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.228844 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.228937 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.229152 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.229239 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.229505 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230032 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230128 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230208 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230297 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230378 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230463 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230601 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230723 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.230959 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.231061 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.231291 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.231377 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.231595 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.231687 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.231918 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.232005 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.232242 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.232327 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.232558 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.232642 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.232860 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.232947 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.233168 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.233260 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.233471 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.233558 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.233773 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.233859 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.234075 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.234165 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.234384 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.234469 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.234687 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.234773 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.235013 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.235101 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.235318 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.235411 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.235619 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.235704 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.235919 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.236005 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.236238 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.236333 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.236544 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.236630 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.236842 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.236926 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.237143 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.237236 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.237446 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.237539 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.237766 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.237851 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.238073 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.238167 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.238382 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.238468 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.238688 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.238774 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.239058 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.239197 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.239367 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.239453 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.239677 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.239761 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.239992 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.240080 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.240304 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.240395 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.240622 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.240707 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.240931 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.241018 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.241239 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.241323 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.241558 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.241650 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.241868 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.241963 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.242181 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.242265 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.242489 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.242572 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.242835 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.242926 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.243137 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.243220 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.243454 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.243550 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.243757 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.243842 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.244070 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.244162 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.244382 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.244539 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.244706 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.244838 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.245039 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.245193 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.245695 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.245811 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.245895 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.245973 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.246057 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.246136 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.246317 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.246417 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.246643 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.246729 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.246981 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.247067 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.247303 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.247398 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.247616 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.247703 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.247923 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.248007 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.248236 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.248322 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.248543 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.248626 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.248863 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.248948 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.249167 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.249254 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.249482 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.249566 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.249784 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.249869 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.250099 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.250185 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.250410 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.250495 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.250730 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.250872 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.251063 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.251151 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.251373 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.251464 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.251692 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.251786 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.251999 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.252085 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.252307 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.252392 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.252617 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.252710 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.252920 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.253006 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.253223 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.253310 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.253533 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.253627 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.253845 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.253937 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.254151 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.254235 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.254457 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.254551 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.254761 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.254908 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.255097 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.255194 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.255405 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.255493 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.255706 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.255798 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.256006 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.256091 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.256314 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.256446 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.256622 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.256707 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.256926 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.257017 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.257230 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.257320 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.257547 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.257633 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.257847 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.257976 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.258148 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.258237 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.258465 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.258551 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.258772 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.258919 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.259108 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.259193 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.259409 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.259493 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.259711 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.259811 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.260033 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.260117 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.260341 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.260437 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.261150 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.261256 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.261779 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.261954 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.262038 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.262122 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.262200 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.262377 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.262466 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.262686 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.262773 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.263018 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.263117 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.263338 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.263424 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.263647 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.263732 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.263954 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.264048 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.264263 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.264348 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.264569 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.264661 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.264876 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.264971 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.265182 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.265269 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.265502 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.265596 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.265809 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.265904 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.266115 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.266202 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.266422 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.266552 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.266721 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.266864 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.267051 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.267138 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.267367 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.267452 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.267691 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.267928 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.268014 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.268257 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.268344 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.268573 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.268667 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.268891 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.268985 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.269209 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.269466 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.269560 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.270066 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.270161 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.270389 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.270475 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.270712 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.270829 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.271061 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.271156 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.271368 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.271462 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.271670 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.271764 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.271972 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.272058 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.272281 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.272368 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.272584 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.272683 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.272888 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.272974 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.273191 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.273277 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.273501 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.273596 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.273802 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.273891 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.274120 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.274211 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.274429 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.274525 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.274730 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.274845 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.275066 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.275152 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.275373 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.275471 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.275683 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.275777 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.275986 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.276072 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.276370 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.276912 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.276912 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.277093 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.277093 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.277239 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.277396 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.277485 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.277711 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.277817 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.278044 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.278130 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.278348 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.278439 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.278661 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.278755 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.278998 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.279085 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.279312 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.279397 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.279639 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.279738 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.279942 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.280038 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.280262 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.280348 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.280565 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.280654 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.280872 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.280957 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.281172 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.281271 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.281480 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.281567 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.281788 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.281881 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.282089 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.282183 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.282395 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.282480 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.282705 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.282809 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.283039 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.283143 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.283348 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.283433 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.283648 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.283733 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.283957 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.284052 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.284258 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.284351 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.284571 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.284657 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.284875 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.284968 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.285175 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.285262 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.285473 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.285558 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.285781 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.285868 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.286087 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.286180 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.286388 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.286474 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.286693 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.286779 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.287024 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.287112 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.287334 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.287425 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.287635 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.287722 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.287937 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.288022 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.288237 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.288383 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.288542 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.288629 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.288847 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.288932 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.289147 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.289241 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.289453 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.289538 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.289762 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.289849 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.290065 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.290160 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.290367 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.290453 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.290672 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.290757 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.291003 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.291103 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.291305 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.291398 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.291612 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.291763 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.292454 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.292610 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.292772 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.292886 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.293097 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.293343 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.293439 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.293661 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.293747 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.293969 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.294054 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.294275 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.294373 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.294582 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.294667 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.294919 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.295008 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.295226 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.295375 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.295527 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.295612 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.295829 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.295913 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.296131 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.296218 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.296432 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.296516 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.296738 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.296869 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.297044 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.297131 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.297350 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.297444 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.297655 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.297749 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.297956 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.298041 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.298315 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.298451 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.298585 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.298680 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.298921 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.299013 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.299232 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.299318 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.299556 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.299658 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.299870 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.299955 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.300179 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.300264 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.300490 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.300585 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.300800 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.300886 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.301101 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.301186 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.301419 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.301512 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.301731 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.301824 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.302042 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.302128 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.302344 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.302516 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.302645 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.302733 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.302984 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.303080 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.303292 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.303387 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.303600 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.303686 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.303907 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.303992 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.304225 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.304316 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.304538 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.304623 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.304837 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.304922 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.305145 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.305233 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.305453 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.305538 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.305761 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.305856 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.306068 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.306155 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.306376 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.306463 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.306684 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.306782 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.307018 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.307109 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.307326 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.307412 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.307703 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.308183 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.308183 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.308329 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.308449 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.308581 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.308673 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.308762 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.308939 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.309040 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.309255 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.309341 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.309566 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.309661 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.309885 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.309972 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.310200 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.310294 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.310509 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.310644 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.310832 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.310939 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.311148 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.311236 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.311481 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.311582 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.311766 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.311853 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.312077 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.312217 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.312397 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.312533 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.312707 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.312837 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.313138 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.313224 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.313445 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.313532 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.313756 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.313842 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.314065 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.314150 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.314366 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.314453 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.314681 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.314778 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.315024 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.315122 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.315342 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.315435 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.315650 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.315737 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.315989 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.316083 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.316292 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.316388 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.316603 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.316688 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.316925 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.317068 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.317230 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.317318 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.317531 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.317616 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.317833 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.317926 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.318154 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.318240 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.318458 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.318546 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.318772 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.318898 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.319099 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.319209 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.319426 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.319512 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.319737 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.319827 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.320061 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.320213 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.320484 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.320582 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.320804 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.320892 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.321116 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.321202 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.321440 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.321536 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.321761 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.321849 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.322065 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.322150 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.322377 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.322473 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.322685 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.322772 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.323047 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.323660 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.323937 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.324329 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.324414 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.324502 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.324583 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.324669 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.324803 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.324963 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.325124 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.325296 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.325445 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.325614 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.325758 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.325937 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.326078 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.326247 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.326492 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.326578 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.326832 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.326937 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.327145 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.327255 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.327467 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.327555 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.327792 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.327948 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.328100 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.328277 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.328403 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.328593 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.328713 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.328920 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.329015 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.329248 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.329335 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.329558 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.329645 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.329868 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.329971 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.330182 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.330269 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.330492 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.330587 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.330807 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.330958 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.331122 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.331210 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.331424 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.331511 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.331738 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.331827 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.332043 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.332128 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.332355 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.332440 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.332664 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.332760 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.332978 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.333065 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.333294 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.333389 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.333640 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.333743 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.333917 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.334003 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.334226 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.334312 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.334530 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.334617 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.334849 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.334938 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.335153 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.335255 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.335493 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.335588 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.335796 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.335886 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.336102 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.336197 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.336411 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.336499 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.336719 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.336805 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.337034 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.337194 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.337357 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.337450 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.337681 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.337773 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.337997 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.338094 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.338317 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.338403 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.338630 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.338716 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.339408 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.339508 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.339592 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.339677 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.339757 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.339835 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.339931 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.340013 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.340171 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.340284 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.340474 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.340593 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.340785 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.340901 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.341086 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.341214 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.341386 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.341523 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.341687 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.341832 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.342008 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.342141 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.342310 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.342454 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.342629 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.342761 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.342963 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.343094 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.343266 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.343401 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.343569 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.343726 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.343871 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.344033 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.344213 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.344358 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.344518 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.344671 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.344854 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.344981 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.345173 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.345290 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.345497 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.345592 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.345824 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.345932 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.346136 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.346225 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.346457 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.346550 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.346771 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.346918 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.347109 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.347198 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.347423 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.347521 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.347738 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.347831 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.348050 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.348145 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.348362 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.348449 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.348675 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.348763 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.348983 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.349125 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.349299 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.349393 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.349611 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.349711 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.349925 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.350012 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.350267 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.350437 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.350582 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.350763 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.350907 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.351099 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.351230 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.351413 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.351552 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.351731 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.352043 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.352130 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.352354 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.352439 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.352663 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.352759 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.352973 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.353067 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.353282 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.353377 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.353593 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.353681 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.353917 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.354015 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.354232 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.354318 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.355360 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.355804 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.355804 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.355972 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356051 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356143 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356143 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356313 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356393 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356467 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356635 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356737 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.356988 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.357077 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.357300 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.357397 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.357605 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.357692 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.357917 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.358010 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.358234 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.358320 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.358545 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.358632 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.358876 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.358967 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.359190 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.359289 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.359500 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.359588 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.359811 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.359897 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.360122 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.360218 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.360431 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.360517 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.360742 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.360828 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.361051 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.361150 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.361367 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.361455 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.361685 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.361779 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.361999 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.362135 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.362317 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.362405 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.362626 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.362712 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.362975 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.363076 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.363314 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.363488 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.363646 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.363803 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.363965 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.364135 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.364284 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.364460 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.364605 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.364783 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.365099 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.365202 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.365415 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.365501 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.365740 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.365825 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.366045 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.366132 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.366346 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.366440 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.366654 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.366833 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.366979 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.367064 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.367279 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.367364 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.367597 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.367696 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.367907 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.367992 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.368208 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.368301 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.368525 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.368620 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.368834 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.368919 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.369156 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.369360 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.369475 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.369701 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.369790 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.370032 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.370725 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.370904 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.371254 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.371398 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.371538 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.371720 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.371843 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.372072 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.372167 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.372396 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.372483 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.372728 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.372815 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.373050 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.373147 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.373359 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.373444 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.373663 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.373748 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.373965 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.374052 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.374274 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.374359 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.374583 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.374668 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.374905 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.374994 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.375215 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.375300 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.375518 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.375603 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.375842 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.375930 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.376146 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.376239 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.376448 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.376534 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.376749 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.376836 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.377058 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.377150 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.377359 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.377458 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.377660 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.377746 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.377963 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.378055 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.378264 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.378358 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.378571 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.378656 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.378894 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.378983 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.379204 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.379307 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.379507 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.379594 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.379815 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.379899 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.380116 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.380210 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.380422 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.380515 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.380723 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.380811 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.381039 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.381132 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.381340 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.381462 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.381642 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.381726 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.381949 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.382043 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.382263 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.382348 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.382571 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.382664 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.382905 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.382993 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.383216 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.383305 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.383528 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.383613 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.383849 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.383936 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.384166 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.384420 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.384506 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.384756 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.384854 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.385080 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.385166 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.385413 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.385510 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.385769 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.386002 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.386165 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.386351 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.386477 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.386670 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.386836 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.387023 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.387134 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.387361 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.387460 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.387700 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.387799 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.388013 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.388100 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.388324 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.388412 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.388634 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.388729 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.388945 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.389031 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.389257 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.389349 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.389568 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.389664 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.389879 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.389964 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.390187 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.390272 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.390497 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.390584 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.390826 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.390915 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.391150 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.391257 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.391467 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.391599 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.391780 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.391871 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.392092 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.392186 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.392406 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.392498 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.392717 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.392804 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.393025 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.393119 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.393331 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.393424 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.393639 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.393732 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.393953 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.394053 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.394279 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.394372 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.394588 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.394947 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.395177 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.395265 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.395506 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.395590 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.395820 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.395908 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.396141 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.396228 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.396473 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.396567 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.396791 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.396877 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.397100 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.397199 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.397419 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.397524 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.397727 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.397847 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.398047 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.398173 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.398355 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.398499 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.398680 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.398839 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.399045 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.399165 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.399371 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.399493 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.399697 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.399795 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.400002 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.400123 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.400302 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.400441 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.400606 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.400773 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.400912 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.401117 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.401240 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.401976 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.402195 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.402420 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.402513 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.402750 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.402863 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.403086 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.403185 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.403400 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.403494 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.403717 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.403807 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.404057 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.404152 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.404391 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.404476 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.404707 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.404793 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.405018 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.405106 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.405339 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.405424 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.405647 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.405731 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.405957 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.406044 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.406268 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.406352 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.406578 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.406671 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.406918 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.407008 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.407232 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.407317 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.407558 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.407656 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.407874 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.407959 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.408176 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.408262 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.408493 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.408592 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.408805 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.408889 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.409119 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.409212 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.409433 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.409527 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.409741 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.409847 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.410068 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.410153 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.410375 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.410468 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.410686 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.410771 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.411018 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.411104 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.411329 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.411417 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.411644 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.411741 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.411958 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.412044 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.412278 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.412363 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.412595 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.412680 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.412916 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.413011 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.413231 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.413326 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.413547 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.413641 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.413869 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.413968 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.414194 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.414280 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.414517 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.414601 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.414851 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.414954 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.415166 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.415251 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.415469 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.415555 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.415711 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 04:36:34.415847 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.416166 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.416516 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.416849 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.417889 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.418211 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.418525 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:36:34.418775 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 04:36:34.439409 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG oslo_db.sqlalchemy.engines [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:36:34.442682 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_db.sqlalchemy.engines [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:36:34.501341 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.context [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a(cell1) {{(pid=108857) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 04:36:34.504060 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.context [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a(cell1) {{(pid=108856) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 04:36:34.505525 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG oslo_concurrency.lockutils [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:36:34.507131 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG oslo_concurrency.lockutils [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:36:34.507942 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG oslo_concurrency.lockutils [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:36:34.508209 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:36:34.509783 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:36:34.509877 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG oslo_concurrency.lockutils [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:36:34.510591 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:36:34.512629 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:36:34.520982 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG oslo_db.sqlalchemy.engines [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:36:34.521801 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG oslo_db.sqlalchemy.engines [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:36:34.524979 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_db.sqlalchemy.engines [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:36:34.528816 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_db.sqlalchemy.engines [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:36:34.681329 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG oslo_db.sqlalchemy.engines [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:36:34.684885 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_db.sqlalchemy.engines [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:36:35.096972 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: WARNING keystonemiddleware.auth_token [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 04:36:35.103664 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: WARNING keystonemiddleware.auth_token [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 04:36:35.154128 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: WARNING keystonemiddleware.auth_token [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 04:36:35.160629 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: WARNING keystonemiddleware.auth_token [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 04:36:35.443224 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: WARNING keystonemiddleware.auth_token [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 04:36:35.448494 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: WARNING keystonemiddleware.auth_token [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 04:36:35.453588 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9c59b59c0 pid: 108857 (default app) Jan 31 04:36:35.455673 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:36:35.456823 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] 10.222.0.21 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jan 31 04:36:35.457233 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 788 bytes} [Mon Jan 31 04:36:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:36:35.513088 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: WARNING keystonemiddleware.auth_token [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 04:36:35.518290 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: WARNING keystonemiddleware.auth_token [None req-880ebb8f-277a-4e52-9fef-3174c3521400 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 04:36:35.523863 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9c59b59c0 pid: 108856 (default app) Jan 31 04:38:03.530913 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:03.532521 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Jan 31 04:38:03.533067 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:03.968944 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-02ba2acc-e464-4770-a925-62b062b4039a admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:03.999024 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-02ba2acc-e464-4770-a925-62b062b4039a admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.459137 Jan 31 04:38:03.999685 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 1/3] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Jan 31 04:38:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:38:06.273818 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:06.275033 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b3acca92-3045-4885-a6a0-739c386f2f4a None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jan 31 04:38:06.276253 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 3/4] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:06.333879 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-f11d2610-c9eb-47c0-b5ba-c505a7ce0328 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "ram": 256, "swap": 0}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:06.351727 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:38:06.351727 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: warnings.warn(msg) Jan 31 04:38:06.442594 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-f11d2610-c9eb-47c0-b5ba-c505a7ce0328 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.160234 Jan 31 04:38:06.443385 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 2/5] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 04:38:06.661767 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-4680c41a-b793-44df-ab19-9cae5c0652a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:06.664162 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:38:06.664162 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: warnings.warn(msg) Jan 31 04:38:06.796604 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-4680c41a-b793-44df-ab19-9cae5c0652a3 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.345300 Jan 31 04:38:06.797190 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 4/6] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Jan 31 04:38:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:38:09.060080 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-f11d2610-c9eb-47c0-b5ba-c505a7ce0328 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:09.060080 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-f11d2610-c9eb-47c0-b5ba-c505a7ce0328 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 31 04:38:09.060080 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 3/7] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:09.170591 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-53c7225e-dc66-4886-818f-597ed0ed4919 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1"}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:09.195442 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:38:09.195442 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: warnings.warn(msg) Jan 31 04:38:09.350949 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-53c7225e-dc66-4886-818f-597ed0ed4919 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.287197 Jan 31 04:38:09.351540 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 5/8] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:38:09.364240 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-a1592a78-01fd-4757-a88f-13c57a442110 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:09.365753 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:38:09.365753 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: warnings.warn(msg) Jan 31 04:38:09.456583 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-a1592a78-01fd-4757-a88f-13c57a442110 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095949 Jan 31 04:38:09.457478 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 4/9] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Jan 31 04:38:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:38:11.724966 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-53c7225e-dc66-4886-818f-597ed0ed4919 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:11.726045 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-53c7225e-dc66-4886-818f-597ed0ed4919 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jan 31 04:38:11.726452 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:11.786346 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-5977e3f9-a05d-4184-905b-06965befd8d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "swap": 0, "id": "d2", "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:11.875222 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-5977e3f9-a05d-4184-905b-06965befd8d3 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141936 Jan 31 04:38:11.875808 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 5/11] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 04:38:11.888266 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-26b4ec53-8c45-40cc-a896-c794836bc58d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:11.993945 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-26b4ec53-8c45-40cc-a896-c794836bc58d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110057 Jan 31 04:38:11.995300 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 7/12] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Jan 31 04:38:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:38:14.292979 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-5977e3f9-a05d-4184-905b-06965befd8d3 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:14.294243 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-5977e3f9-a05d-4184-905b-06965befd8d3 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Jan 31 04:38:14.295129 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 6/13] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:14.359287 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-ef029935-5e88-4228-99af-3a33c2169b38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:14.434367 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-ef029935-5e88-4228-99af-3a33c2169b38 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133051 Jan 31 04:38:14.434931 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 8/14] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:38:14.446597 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-7b998aaa-572a-4f02-ae22-0c1776fba088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:14.540649 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-7b998aaa-572a-4f02-ae22-0c1776fba088 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097642 Jan 31 04:38:14.541529 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 7/15] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Jan 31 04:38:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:38:16.795686 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-ef029935-5e88-4228-99af-3a33c2169b38 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:16.796700 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-ef029935-5e88-4228-99af-3a33c2169b38 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jan 31 04:38:16.797105 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 9/16] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:16.857050 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-ef67cb47-ab9d-42f3-bbf4-37cb13baaa72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "vcpus": 4, "ram": 4096, "name": "ds4G", "id": "d4"}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:16.933000 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-ef67cb47-ab9d-42f3-bbf4-37cb13baaa72 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130108 Jan 31 04:38:16.933554 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 8/17] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:38:16.945051 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-fe5336c3-539c-42f0-bf2e-cd570e533d6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:17.022145 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-fe5336c3-539c-42f0-bf2e-cd570e533d6c admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080468 Jan 31 04:38:17.022629 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 10/18] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Jan 31 04:38:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:38:19.298461 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-ef67cb47-ab9d-42f3-bbf4-37cb13baaa72 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:19.299581 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-ef67cb47-ab9d-42f3-bbf4-37cb13baaa72 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jan 31 04:38:19.305526 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 9/19] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:19.366073 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-6a30b150-332f-4a7b-8ca6-3cd6e980d8c0 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:19.395354 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-6a30b150-332f-4a7b-8ca6-3cd6e980d8c0 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088541 Jan 31 04:38:19.396572 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 11/20] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Jan 31 04:38:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:38:21.667564 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-ef67cb47-ab9d-42f3-bbf4-37cb13baaa72 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:21.668613 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-ef67cb47-ab9d-42f3-bbf4-37cb13baaa72 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jan 31 04:38:21.669036 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 10/21] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:21.739971 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-6e74cd38-1f63-460a-b506-93547116b12a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "vcpus": 1, "swap": 0, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:21.817348 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-6e74cd38-1f63-460a-b506-93547116b12a admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.142340 Jan 31 04:38:21.818056 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 12/22] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 04:38:21.830104 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-8a451330-87fa-4312-9180-7ca2c516c08d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:21.918676 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-8a451330-87fa-4312-9180-7ca2c516c08d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091997 Jan 31 04:38:21.919226 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 11/23] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Jan 31 04:38:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:38:24.178387 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-6e74cd38-1f63-460a-b506-93547116b12a admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:24.179440 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-6e74cd38-1f63-460a-b506-93547116b12a admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jan 31 04:38:24.179924 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:24.238904 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-5e2710a4-90ba-4920-81fd-522cadd31c0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "swap": 0}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:24.311557 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-5e2710a4-90ba-4920-81fd-522cadd31c0d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.125242 Jan 31 04:38:24.312331 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 12/25] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:38:24.324169 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-46b1ab47-2051-4f7a-9b4c-765eed8d87cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:24.403376 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-46b1ab47-2051-4f7a-9b4c-765eed8d87cd admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082913 Jan 31 04:38:24.403991 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 14/26] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Jan 31 04:38:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:38:26.642483 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-5e2710a4-90ba-4920-81fd-522cadd31c0d admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:26.643542 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-5e2710a4-90ba-4920-81fd-522cadd31c0d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001829 Jan 31 04:38:26.643951 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 13/27] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:26.701853 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-0f4956c6-2186-4252-b8eb-5f1f6a11cb21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:26.822283 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-0f4956c6-2186-4252-b8eb-5f1f6a11cb21 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.172612 Jan 31 04:38:26.822854 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 15/28] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 04:38:26.834447 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-a2db1d83-6bd1-4e0b-acd6-f1e40ea0dd5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:26.906987 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-a2db1d83-6bd1-4e0b-acd6-f1e40ea0dd5a admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076123 Jan 31 04:38:26.907589 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 14/29] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Jan 31 04:38:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:38:29.167129 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-0f4956c6-2186-4252-b8eb-5f1f6a11cb21 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:29.168149 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-0f4956c6-2186-4252-b8eb-5f1f6a11cb21 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jan 31 04:38:29.168834 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 16/30] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:29.238251 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-e5dc4c6e-291a-4aae-845c-42162a1ec9a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "disk": 80, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:29.309552 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-e5dc4c6e-291a-4aae-845c-42162a1ec9a3 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134751 Jan 31 04:38:29.310328 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 15/31] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:38:29.321951 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b36183ab-58fa-47fd-989f-6b4a54999015 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:29.415062 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b36183ab-58fa-47fd-989f-6b4a54999015 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096685 Jan 31 04:38:29.416240 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 17/32] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Jan 31 04:38:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:38:31.739988 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-e5dc4c6e-291a-4aae-845c-42162a1ec9a3 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:31.741794 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-e5dc4c6e-291a-4aae-845c-42162a1ec9a3 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002253 Jan 31 04:38:31.742522 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 16/33] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:31.808310 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-c13fa036-da1b-4b3a-a3ad-f9c6711f3c5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "vcpus": 8, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:31.943418 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-c13fa036-da1b-4b3a-a3ad-f9c6711f3c5d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.193932 Jan 31 04:38:31.943934 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 18/34] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Jan 31 04:38:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 04:38:31.955710 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-8a7881a0-43b8-444a-99e8-dbe366869098 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:38:32.079635 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-8a7881a0-43b8-444a-99e8-dbe366869098 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127372 Jan 31 04:38:32.080437 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 17/35] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Jan 31 04:38:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:38:55.879090 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-c13fa036-da1b-4b3a-a3ad-f9c6711f3c5d admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:55.880132 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-c13fa036-da1b-4b3a-a3ad-f9c6711f3c5d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jan 31 04:38:55.880535 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 19/36] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:55.938590 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-6e4ef62e-7215-4c0d-ab97-3835f408831c admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:55.955496 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-6e4ef62e-7215-4c0d-ab97-3835f408831c admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068887 Jan 31 04:38:55.956028 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Jan 31 04:38:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:38:57.333375 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-c13fa036-da1b-4b3a-a3ad-f9c6711f3c5d admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:57.334380 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-c13fa036-da1b-4b3a-a3ad-f9c6711f3c5d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jan 31 04:38:57.334811 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 20/38] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:57.529403 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-f335ff07-7dfa-426e-83c2-891bfa9e7f6c admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:57.534767 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.wsgi [None req-f335ff07-7dfa-426e-83c2-891bfa9e7f6c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 31 04:38:57.539882 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-f335ff07-7dfa-426e-83c2-891bfa9e7f6c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:38:57.539882 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-f335ff07-7dfa-426e-83c2-891bfa9e7f6c admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059944 Jan 31 04:38:57.539882 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 19/39] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Jan 31 04:38:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:57.546585 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-59ae114c-ee02-4e80-8704-e8996ade8190 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:57.566699 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-59ae114c-ee02-4e80-8704-e8996ade8190 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023666 Jan 31 04:38:57.567287 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 21/40] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Jan 31 04:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:38:57.576912 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-a773ec27-a911-4b39-8170-b5fd9874c2e2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:57.598170 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-a773ec27-a911-4b39-8170-b5fd9874c2e2 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024709 Jan 31 04:38:57.598699 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 20/41] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Jan 31 04:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:38:57.609603 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-4eb5d186-9864-4a0c-a4eb-760a8076d121 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:57.615088 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.wsgi [None req-4eb5d186-9864-4a0c-a4eb-760a8076d121 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 31 04:38:57.615654 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-4eb5d186-9864-4a0c-a4eb-760a8076d121 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:38:57.616443 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-4eb5d186-9864-4a0c-a4eb-760a8076d121 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011433 Jan 31 04:38:57.616942 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 22/42] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Jan 31 04:38:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:58.871122 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-a773ec27-a911-4b39-8170-b5fd9874c2e2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:58.872132 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-a773ec27-a911-4b39-8170-b5fd9874c2e2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jan 31 04:38:58.872519 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 21/43] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:38:59.063334 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-53b20f57-379a-4649-ac06-09c45ea18017 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:59.068524 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.wsgi [None req-53b20f57-379a-4649-ac06-09c45ea18017 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 31 04:38:59.069088 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-53b20f57-379a-4649-ac06-09c45ea18017 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:38:59.069881 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-53b20f57-379a-4649-ac06-09c45ea18017 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058458 Jan 31 04:38:59.070387 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 23/44] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Jan 31 04:38:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:59.080402 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-4df07967-d949-49e5-a1bb-ff73c6f8364b admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:59.093898 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-4df07967-d949-49e5-a1bb-ff73c6f8364b admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016998 Jan 31 04:38:59.094437 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 22/45] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Jan 31 04:38:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:38:59.104116 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-764214c2-a215-45ea-a923-5353ff7be0b8 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:59.117709 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-764214c2-a215-45ea-a923-5353ff7be0b8 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017453 Jan 31 04:38:59.118230 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Jan 31 04:38:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:38:59.127646 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-ef9df3b8-9a8e-4ad7-8278-c9b83e9213d0 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:38:59.132688 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.wsgi [None req-ef9df3b8-9a8e-4ad7-8278-c9b83e9213d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 31 04:38:59.133241 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-ef9df3b8-9a8e-4ad7-8278-c9b83e9213d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:38:59.134009 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-ef9df3b8-9a8e-4ad7-8278-c9b83e9213d0 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009819 Jan 31 04:38:59.135066 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 23/47] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Jan 31 04:38:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 31 04:39:00.401218 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-764214c2-a215-45ea-a923-5353ff7be0b8 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:00.402218 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-764214c2-a215-45ea-a923-5353ff7be0b8 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 Jan 31 04:39:00.402610 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 25/48] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:39:00.592528 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-81d827c3-3bde-43f4-b0a7-80afd8531c75 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:00.597586 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.wsgi [None req-81d827c3-3bde-43f4-b0a7-80afd8531c75 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 31 04:39:00.598138 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-81d827c3-3bde-43f4-b0a7-80afd8531c75 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:39:00.598949 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-81d827c3-3bde-43f4-b0a7-80afd8531c75 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057938 Jan 31 04:39:00.599450 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 24/49] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Jan 31 04:39:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:00.608721 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-2a544b78-d0b1-4d9f-b0d0-98ffe38d5fa0 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:00.622570 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-2a544b78-d0b1-4d9f-b0d0-98ffe38d5fa0 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017244 Jan 31 04:39:00.623072 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 26/50] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Jan 31 04:39:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:39:00.632180 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:00.645733 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017260 Jan 31 04:39:00.646240 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 25/51] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Jan 31 04:39:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:39:00.655193 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-8ecbcce0-96de-405b-9a5a-ab540e21c8f2 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:00.660259 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.wsgi [None req-8ecbcce0-96de-405b-9a5a-ab540e21c8f2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 31 04:39:00.660822 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-8ecbcce0-96de-405b-9a5a-ab540e21c8f2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:39:00.661596 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-8ecbcce0-96de-405b-9a5a-ab540e21c8f2 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009888 Jan 31 04:39:00.662084 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 27/52] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Jan 31 04:39:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 31 04:39:01.929161 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:01.930172 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jan 31 04:39:01.930582 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 26/53] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:39:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:39:02.127288 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-29afdd19-4590-4f60-8000-84d1ec34a99e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:39:02.199518 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-29afdd19-4590-4f60-8000-84d1ec34a99e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.122957 Jan 31 04:39:02.200063 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 28/54] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Jan 31 04:39:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:39:03.465671 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:03.466673 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jan 31 04:39:03.467106 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 27/55] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:39:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:39:03.660895 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-60a846df-14a6-4587-a110-d06f6e8dac3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:39:03.714390 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-60a846df-14a6-4587-a110-d06f6e8dac3d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.105289 Jan 31 04:39:03.714980 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 29/56] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Jan 31 04:39:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:39:05.006448 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:05.007523 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jan 31 04:39:05.007921 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 28/57] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:39:05.199660 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b0414db7-b0c9-4012-87f7-3ad2434e6bc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:39:05.272482 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b0414db7-b0c9-4012-87f7-3ad2434e6bc4 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.123778 Jan 31 04:39:05.272931 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 30/58] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Jan 31 04:39:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:39:06.554514 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:06.555557 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jan 31 04:39:06.555957 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 29/59] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:39:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:39:06.749074 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-fee22d0c-7bfb-483f-94fc-b61e3b58f2ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:39:06.816171 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-fee22d0c-7bfb-483f-94fc-b61e3b58f2ab admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.118644 Jan 31 04:39:06.816642 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 31/60] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Jan 31 04:39:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:39:08.078712 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:08.079778 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 31 04:39:08.080181 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 30/61] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:39:08.272831 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-14a607be-a979-404a-b865-315ce11cf779 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:08.293249 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-14a607be-a979-404a-b865-315ce11cf779 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070265 Jan 31 04:39:08.293780 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 32/62] 10.222.0.21 () {60 vars in 1202 bytes} [Mon Jan 31 04:39:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:39:54.236596 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:54.237609 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-04536d90-5b1f-49ad-b61e-33f557cdb2f2 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jan 31 04:39:54.238010 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 31/63] 10.222.0.21 () {54 vars in 930 bytes} [Mon Jan 31 04:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:39:54.294704 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-55ad139a-6d8e-475a-a93c-a5629e9070b9 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:54.313833 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-55ad139a-6d8e-475a-a93c-a5629e9070b9 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069453 Jan 31 04:39:54.314361 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 33/64] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Jan 31 04:39:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:39:54.336166 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-68039b8d-6ae9-4da8-a75b-ce5047d58123 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:54.343738 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-68039b8d-6ae9-4da8-a75b-ce5047d58123 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011218 Jan 31 04:39:54.344256 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 32/65] 10.222.0.21 () {60 vars in 1282 bytes} [Mon Jan 31 04:39:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:39:54.355784 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-74401d79-95f6-445f-bdac-9cb6bcf742ad admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:54.363199 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-74401d79-95f6-445f-bdac-9cb6bcf742ad admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010948 Jan 31 04:39:54.363699 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 34/66] 10.222.0.21 () {60 vars in 1285 bytes} [Mon Jan 31 04:39:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:39:54.375116 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-d2f10c89-2b45-4271-aea5-aa2e3a1107e2 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:54.382709 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-d2f10c89-2b45-4271-aea5-aa2e3a1107e2 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010943 Jan 31 04:39:54.383256 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 33/67] 10.222.0.21 () {60 vars in 1285 bytes} [Mon Jan 31 04:39:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:39:54.393974 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:39:54.402427 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011757 Jan 31 04:39:54.402959 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 35/68] 10.222.0.21 () {60 vars in 1282 bytes} [Mon Jan 31 04:39:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:41:56.564817 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-2b7170cc-63b4-4fc6-bfa9-643c710a60a7 tempest-verify_tempest_config-781750269 tempest-verify_tempest_config-781750269-project] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:41:56.566771 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-2b7170cc-63b4-4fc6-bfa9-643c710a60a7 tempest-verify_tempest_config-781750269 tempest-verify_tempest_config-781750269-project] 10.222.0.21 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105736 Jan 31 04:41:56.567340 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 34/69] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Jan 31 04:41:56 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:43:27.776239 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:43:27.777264 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jan 31 04:43:27.777658 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:43:28.029608 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-274c801b-7a5d-40a7-a3a2-6518b57488f8 admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:43:28.030867 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:43:28.030867 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: warnings.warn(msg) Jan 31 04:43:28.032390 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-274c801b-7a5d-40a7-a3a2-6518b57488f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:43:28.032825 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-274c801b-7a5d-40a7-a3a2-6518b57488f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:43:28.033649 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-274c801b-7a5d-40a7-a3a2-6518b57488f8 admin admin] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:43:28.034072 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-274c801b-7a5d-40a7-a3a2-6518b57488f8 admin admin] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:43:28.067216 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-274c801b-7a5d-40a7-a3a2-6518b57488f8 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148588 Jan 31 04:43:28.067773 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 35/71] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Jan 31 04:43:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:43:29.351063 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:43:29.352101 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jan 31 04:43:29.352506 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:43:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:43:29.544481 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-af32d615-8e54-4cbd-8b89-b543fd01e1bf admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:43:29.545642 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:43:29.545642 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: warnings.warn(msg) Jan 31 04:43:29.547201 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-af32d615-8e54-4cbd-8b89-b543fd01e1bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:43:29.547644 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-af32d615-8e54-4cbd-8b89-b543fd01e1bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:43:29.548442 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-af32d615-8e54-4cbd-8b89-b543fd01e1bf admin admin] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:43:29.548897 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-af32d615-8e54-4cbd-8b89-b543fd01e1bf admin admin] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:43:29.568398 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-af32d615-8e54-4cbd-8b89-b543fd01e1bf admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075417 Jan 31 04:43:29.568943 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 36/73] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Jan 31 04:43:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:43:41.314194 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:43:41.315219 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jan 31 04:43:41.316125 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 38/74] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:43:41.510738 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-fb84e80c-596e-4d3a-8d95-ba6772629ecd admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:43:41.511922 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:43:41.511922 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: warnings.warn(msg) Jan 31 04:43:41.513439 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-fb84e80c-596e-4d3a-8d95-ba6772629ecd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:43:41.513884 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-fb84e80c-596e-4d3a-8d95-ba6772629ecd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:43:41.514681 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-fb84e80c-596e-4d3a-8d95-ba6772629ecd admin admin] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:43:41.515137 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-fb84e80c-596e-4d3a-8d95-ba6772629ecd admin admin] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:43:41.539538 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-fb84e80c-596e-4d3a-8d95-ba6772629ecd admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078642 Jan 31 04:43:41.540084 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 37/75] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Jan 31 04:43:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:43:42.821419 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: DEBUG nova.api.openstack.wsgi [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] Calling method '>' {{(pid=108857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:43:42.822520 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: INFO nova.api.openstack.requestlog [None req-b1b235ba-de80-4f87-af1b-943c6baf0e82 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jan 31 04:43:42.822951 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: [pid: 108857|app: 0|req: 39/76] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Jan 31 04:43:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:43:43.016692 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG nova.api.openstack.wsgi [None req-9f0a8f07-8a7c-4d26-b76a-f7682956a3ab admin admin] Calling method '>' {{(pid=108856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:43:43.017854 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:43:43.017854 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: warnings.warn(msg) Jan 31 04:43:43.019595 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-9f0a8f07-8a7c-4d26-b76a-f7682956a3ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:43:43.020138 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-9f0a8f07-8a7c-4d26-b76a-f7682956a3ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:43:43.021036 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-9f0a8f07-8a7c-4d26-b76a-f7682956a3ab admin admin] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:43:43.021474 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: DEBUG oslo_concurrency.lockutils [None req-9f0a8f07-8a7c-4d26-b76a-f7682956a3ab admin admin] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:43:43.043167 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: INFO nova.api.openstack.requestlog [None req-9f0a8f07-8a7c-4d26-b76a-f7682956a3ab admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078623 Jan 31 04:43:43.043668 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: [pid: 108856|app: 0|req: 38/77] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Jan 31 04:43:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:44:40.415818 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: Mon Jan 31 04:44:40 2022 - graceful shutdown triggered... Jan 31 04:44:40.415943 dv-cinder-826608-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 31 04:44:40.416879 dv-cinder-826608-2-iscsi devstack@n-api.service[108856]: Gracefully killing worker 1 (pid: 108856)... Jan 31 04:44:40.417305 dv-cinder-826608-2-iscsi devstack@n-api.service[108857]: Gracefully killing worker 2 (pid: 108857)... Jan 31 04:44:41.418055 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: worker 1 buried after 1 seconds Jan 31 04:44:41.418055 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: worker 2 buried after 1 seconds Jan 31 04:44:41.418055 dv-cinder-826608-2-iscsi devstack@n-api.service[108855]: goodbye to uWSGI. Jan 31 04:44:41.419502 dv-cinder-826608-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 31 04:44:41.420046 dv-cinder-826608-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 31 04:44:41.422904 dv-cinder-826608-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 31 04:44:41.434688 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 31 04:44:41 2022] *** Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: nodename: dv-cinder-826608-2-iscsi Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: machine: x86_64 Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: clock source: unix Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: pcre jit disabled Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: detected number of CPU cores: 4 Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: current working directory: / Jan 31 04:44:41.436920 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: detected binary path: /usr/bin/uwsgi-core Jan 31 04:44:41.437553 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: your processes number limit is 47680 Jan 31 04:44:41.437553 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: your memory page size is 4096 bytes Jan 31 04:44:41.437553 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: detected max file descriptor number: 2048 Jan 31 04:44:41.437553 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: lock engine: pthread robust mutexes Jan 31 04:44:41.437553 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: thunder lock: enabled Jan 31 04:44:41.437553 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 31 04:44:41.437553 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 31 04:44:41.489548 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: Python main interpreter initialized at 0x55872df8b9c0 Jan 31 04:44:41.489548 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: python threads support enabled Jan 31 04:44:41.489548 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: your server socket listen backlog is limited to 100 connections Jan 31 04:44:41.489548 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: your mercy for graceful operations on workers is 90 seconds Jan 31 04:44:41.489991 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: mapped 403077 bytes (393 KB) for 2 cores Jan 31 04:44:41.489991 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: *** Operational MODE: preforking *** Jan 31 04:44:41.490249 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: *** uWSGI is running in multiple interpreter mode *** Jan 31 04:44:41.490249 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: spawned uWSGI master process (pid: 123347) Jan 31 04:44:41.490435 dv-cinder-826608-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 31 04:44:41.491013 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: spawned uWSGI worker 1 (pid: 123367, cores: 1) Jan 31 04:44:41.491820 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: spawned uWSGI worker 2 (pid: 123368, cores: 1) Jan 31 04:44:41.491820 dv-cinder-826608-2-iscsi devstack@n-api.service[123347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 31 04:44:43.454548 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:44:43.454548 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: from cryptography.utils import int_from_bytes Jan 31 04:44:43.455880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:44:43.455880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: from cryptography.utils import int_from_bytes Jan 31 04:44:43.464374 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:44:43.464374 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: from cryptography.utils import int_from_bytes Jan 31 04:44:43.464965 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:44:43.464965 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: from cryptography.utils import int_from_bytes Jan 31 04:44:45.849600 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 04:44:45.850170 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 04:44:45.850266 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 04:44:45.850604 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 04:44:45.850887 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 04:44:45.851278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.851602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.851923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.852239 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.852564 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.852873 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.853192 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.853509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.853837 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.854096 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.854409 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.854731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-2-iscsi {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.855083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.855391 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.855698 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.856016 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.856318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.856635 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.856943 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.857435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.858167 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.858477 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.858926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.859249 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.859579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.859897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.860180 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.860482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.861340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.861655 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.862065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-2-iscsi {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.862392 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.862698 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.863042 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.865801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.865801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.865801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.865801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.865801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.865801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.865801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.865801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.866481 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.866481 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.866481 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.866936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.867181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.867426 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.867719 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.868016 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.868258 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.868573 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.868891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.869196 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.869520 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.869774 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.870029 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.870344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.870661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.870997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.871307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.871615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.871923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.872231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.872535 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.872843 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.873147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.873464 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.873778 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.874099 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.874406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.874721 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.875146 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.875399 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.875707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.876047 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.876916 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.877226 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.877547 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.877871 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.878180 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.878488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.878843 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.879186 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.879477 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.879808 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.880071 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.880320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.880623 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.880942 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.881250 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.881556 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.881862 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.882420 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.882727 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.883062 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.883371 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.883676 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.883982 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.884286 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.884593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.884897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.885199 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.885518 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.885839 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.886143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.886447 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.886751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.887080 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.887399 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.887705 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.888009 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.888331 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.888642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.888944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.889319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.889562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.889933 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.890178 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.890504 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.890776 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.891115 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.891423 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.891745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.892050 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.892354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.892662 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.892942 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.893282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.893570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.893828 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.894143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.894462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.894771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.895117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.895421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.895740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.896076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.896406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.896746 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.897060 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.897392 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.897723 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.898040 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.898350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.898668 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.899015 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.899464 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.899640 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.900047 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.900242 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.900615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.900861 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.901179 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.901491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.901807 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.902115 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.902431 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.902756 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.903112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.903452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.903756 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.904089 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.904402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.904724 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.905031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.905351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.905660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.905969 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.906280 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.906608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.906943 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.907254 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.907616 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.907919 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.908236 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.908912 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.909142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.909452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.909757 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.910053 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.910377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.910702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.911048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.911384 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.911688 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.911996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.912306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.912613 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.912916 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.913226 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.913532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.913834 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.914157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.914463 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.914763 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.915103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.915405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.915709 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.916021 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.916328 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.916635 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.916943 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.917262 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.917570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.917878 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.918209 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.918539 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.918945 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.919184 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.919507 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.919821 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.920121 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.920427 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.920726 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.921029 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.921331 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.921638 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.921937 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.922241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.922541 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.922863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.923757 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.924125 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.924608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.924922 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.925226 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.925532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.925875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.926181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.926523 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.926880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.927204 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.927528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.927841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.928157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.928464 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.928775 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.929090 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.929404 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.929717 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.930029 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.930352 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.930651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.931004 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.931304 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.931631 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.931931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.932246 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.932582 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.932913 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.933228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.933548 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.933859 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.934169 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.934476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.934811 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.935126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.935432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.935749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.936057 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.936372 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.936677 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.936997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.937303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.937618 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.937919 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.938232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.938557 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.939518 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.939848 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.940157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.940478 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.940787 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.941098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.941406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.941710 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.942014 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.942330 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.942638 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.942974 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.943284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.943587 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.943917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.944200 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.944453 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 04:44:45.944958 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.945116 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 04:44:45.945295 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.945450 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 04:44:45.945606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.945606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.945892 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 04:44:45.945892 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 04:44:45.946185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.946185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.946492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.946644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.946835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.946987 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.947143 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.947295 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.947456 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.947609 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.947752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.947896 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.948047 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.948320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.948497 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.948644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.948803 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.948961 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.949107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.949258 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.949416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.949571 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.949716 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.949886 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.950114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-2-iscsi {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.950359 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.950528 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.950696 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.950973 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.951156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.951401 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.951628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.951873 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.952025 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.952171 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.952330 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.952563 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.952723 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.952884 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.953051 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.953219 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.953384 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.953384 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.953674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.953874 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.954126 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.954278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.954465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.954613 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.954769 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.954981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.955146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.955300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.955444 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.955603 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.955757 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.955909 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.956061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.956206 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.956206 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.956506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.956652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.956804 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.956804 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-2-iscsi {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.957104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.957333 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.957480 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.957623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.957772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.957925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.958069 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.958069 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.958466 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.958620 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.958765 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.958765 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.959088 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.959247 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.959393 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.959393 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.959680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.959832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.959987 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.960223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.960389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.960619 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.960776 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.960959 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.961320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.961570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.961773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.962012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.962166 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.962318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.962486 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.962726 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.962922 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.963637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.963799 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.963946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.964136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.964368 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.964532 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.964680 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.964833 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.964992 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.965145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.965300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.965451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.965606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.965751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.965905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.966063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.966219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.966372 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.966518 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.966669 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.966855 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.967016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.967171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.967318 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.967470 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.967631 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.967787 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.967947 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.968092 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.968235 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.968380 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.968662 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.968816 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.968961 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.969113 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.969258 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.969258 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.969541 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.969541 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.969834 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.970011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.970163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.970412 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.970565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.971053 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.971242 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.971597 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.971839 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.972081 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.972330 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.972492 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.972647 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.972899 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.973071 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.973232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.973388 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.973533 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.973678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.973832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.973976 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.974130 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.974130 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.974130 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.974668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.974834 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.975009 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.975166 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.975166 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.975454 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.975608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.975761 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.975917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.976062 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.976205 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.976364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.976517 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.976661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.976820 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.976984 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.977130 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.977281 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.977433 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.977577 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.977730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.977884 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.978032 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.978176 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.978333 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.978485 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.978663 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.978935 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.979031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.979165 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.979268 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.979367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.979454 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.979547 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.979644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.979744 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.979846 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.979933 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.980019 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.980110 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.980202 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.980288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.980406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.980550 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.980655 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.980750 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.980836 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.980943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.981047 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.981134 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.981218 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.981309 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.981403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.981504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.981875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.981972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.982058 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.982142 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.982225 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.982335 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.982430 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.982525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.982618 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.982704 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.982934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.982934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.983132 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.983227 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.983321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.983415 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.983508 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.983605 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.983698 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.983783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.983881 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.983976 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.984069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.984169 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.984261 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.984347 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.984441 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.984543 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.984636 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.984729 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.984813 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.984897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.984991 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.985084 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.985170 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.985253 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.985336 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.985429 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.985521 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.986135 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.986227 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.986422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.986525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.986622 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.986709 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.986782 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.986782 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.987086 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.987182 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.987277 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.987371 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.987563 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.987679 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.987876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.987970 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.988183 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.988293 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.988510 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.988612 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.988815 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.988933 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.989136 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.989242 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.989442 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.989534 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.989748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.989918 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.990066 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.990158 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:44:45.990392 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.990493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.990716 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.991060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.991154 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.991245 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.991339 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.991425 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.991631 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.991956 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.992052 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.992150 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.992237 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.992382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.992517 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.992697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.992824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.993036 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.993151 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.993349 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.993458 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.993666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.993760 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.993981 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.994075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.994296 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.994398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.994601 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.994703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.994929 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.995025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.995232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.995342 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.995555 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.995652 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.995862 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.995964 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.996162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.996257 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.996467 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.996572 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.996770 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.996863 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.997082 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.997188 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.997381 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.997474 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.997713 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.997808 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.998056 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.998151 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.998398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.998497 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.998700 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.998825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.999037 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.999141 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.999353 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.999484 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.999665 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.999775 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:45.999977 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.000073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.000283 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.000392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.000614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.000723 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.000933 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.001029 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.001303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.002113 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.002264 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.002570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.002713 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.002926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.003021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.003199 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.003525 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.003843 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.004148 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.004266 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.004473 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.004571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.004779 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.004876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.005056 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.005160 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.005378 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.005490 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.005723 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.005884 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.006047 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.006352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.006688 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.007006 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.007369 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.007609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.007694 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.007921 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.008167 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.008266 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.008524 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.008621 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.008843 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.008949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.009155 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.009249 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.009477 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.009575 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.010079 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.010209 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.010302 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.010457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.010588 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.010772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.010916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.011014 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.011106 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.011361 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.011478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.011644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.011739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.011971 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.012074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.012298 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.012492 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.012606 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.012782 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.012916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.013124 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.013226 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.013490 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.013607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.013819 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.013924 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.014149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.014244 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.014484 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.014578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.014856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.014967 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.015144 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.015249 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.015491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.015621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.015802 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.015917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.016120 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.016214 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.016428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.016530 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.016739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.016886 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.017177 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.017574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.017697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.017846 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.017950 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.018161 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.018264 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.018493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.018589 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.018814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.018936 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.019143 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.019239 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.019456 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.019549 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.019770 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.019879 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.020085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.020228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.020411 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.020513 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.020724 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.020829 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.021035 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.021135 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.021346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.021446 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.021657 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.021767 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.021985 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.022084 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.022304 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.022451 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.022681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.022865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.023012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.023146 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.023322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.023457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.023656 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.023821 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.024029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.024175 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.024319 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.024452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.024598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.024738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.024882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.025016 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.025189 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.025325 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.025505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.025643 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.025831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.025976 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.026145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.026289 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.026470 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.026607 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.026784 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.026953 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.027133 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.027270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.027448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.027585 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.027809 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.027952 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.028085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.028232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.028373 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.028506 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.028705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.028840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.029043 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.029190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.029358 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.029492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.029669 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.029812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.029980 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.030142 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.030362 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.030506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.030638 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.030768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.031017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.031233 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.031379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.031527 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.031734 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.031870 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.032016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.032158 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.032314 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.032538 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.033335 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.033490 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.033490 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.033756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.033897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.034043 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.034241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.034375 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.034524 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.034661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.034807 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.034954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.035087 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.035217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.035362 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.035495 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.035635 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.035767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.035905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.036047 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.036178 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.036318 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.036456 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.036588 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.036726 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.036872 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.037008 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.037144 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.037275 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.037412 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.037551 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.037703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.037933 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.038078 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.038219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.038367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.038500 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.038650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.038819 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.038955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.039139 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.039378 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.039530 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.039715 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.039852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.040037 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.040185 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.040439 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.040659 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.040797 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.040928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.041059 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.041219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.041360 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.041507 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.041639 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.041861 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.041996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.042125 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.042268 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.042409 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.042616 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.042773 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.043005 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.043156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.043299 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.043437 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.043570 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.043690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.043819 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.043949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.044094 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.044249 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.044454 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.044589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.044728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.044863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.045012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.045145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.045283 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.045422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.045569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.045750 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.045895 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.046063 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.046208 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.046385 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.046520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.046707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.046983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.047120 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.047250 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.047381 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.047519 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.047666 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.047799 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.047945 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.048663 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.048798 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.049111 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.049255 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.049436 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.049571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.049759 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.049895 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.050083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.050221 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.050417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.050666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.050845 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.051128 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.051283 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.051405 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.051544 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.051677 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.051808 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.052044 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.052181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.052321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.052461 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.052616 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.052851 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.053016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.053228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.053367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.053505 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.053638 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.053829 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.053979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.054155 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.054304 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.054520 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.054671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.054869 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.055019 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.055153 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.055293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.055434 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.055573 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.055740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.055878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.056059 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.056196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.056370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.056506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.056680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.056815 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.056998 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.057142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.057306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.057448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.057614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.057759 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.057925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.058060 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.058282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.058536 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.058686 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.058900 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.059039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.059212 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.059355 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.059523 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.059661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.059841 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.059985 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.060150 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.060286 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.060466 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.060610 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.060852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.060990 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.061138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.061272 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.061403 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.061523 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.061677 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.061820 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.062089 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.062245 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.062379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.062509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.062640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.062829 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.063024 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.063194 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.063393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.063544 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.063544 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.064369 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.064493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.064786 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.065122 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.065435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.065748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.065961 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.066107 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.066303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.066439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.066634 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.066784 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.066983 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.067118 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.067297 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.067443 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.067609 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.067747 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.067926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.068062 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.068313 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.068465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.068613 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.068747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.068878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.069018 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.069159 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.069305 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.069445 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.069591 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.074451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.075806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.075806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.076086 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.076086 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.076350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.076492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.076633 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.076774 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.076910 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.077057 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.077199 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.077340 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.077473 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.077604 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.077742 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.077889 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.078022 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.078191 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.078325 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.078545 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.078689 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.078950 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.079080 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.079192 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.079192 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.079434 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.079550 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.079690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.079979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.080116 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.080240 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.080363 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.080491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.080614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.080726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.080838 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.080948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.081078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.081200 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.081322 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.081452 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.081580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.081693 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.081812 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.081934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.082048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.082171 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.082301 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.082506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.082634 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.082773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.082915 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.083042 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.083181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.083380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.083531 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.083726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.083858 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.083983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.084094 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.084220 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.084344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.084344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.085263 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.085410 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.085544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.085685 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.086203 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.086339 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.086460 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.086581 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.086705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.086857 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.086984 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.087114 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.087237 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.087357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.087486 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.087607 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.087721 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.087841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.087963 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.088075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.088201 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.088323 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.088436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.088565 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.088773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.088891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089137 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089386 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089622 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089736 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089854 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.089967 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.090078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.090189 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.090313 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.090427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.090546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.090661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.090780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.090934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.091082 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.091217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.091355 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.091487 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.091625 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.091849 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.092009 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.092145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.092145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.092407 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.092630 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.092782 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.092924 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.093056 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.093188 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.093318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.093318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.093674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.093674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.094028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.094163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.094301 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.094432 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.094572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.094726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.095007 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.095146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.095416 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.095416 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.095736 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.095876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.096017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.096017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.096265 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.096412 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.096544 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.096675 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.096813 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.096946 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.097078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.097219 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.097353 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.097483 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.097613 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.097751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.097889 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.098034 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.098174 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.098305 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.098437 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.098575 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.098720 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.098883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.099076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.099288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.099425 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.099425 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.099737 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.099890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.100024 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.100155 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.100286 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.100417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.100565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.100734 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.100868 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.100999 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.101139 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.101280 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.101421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.101562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.101694 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.101832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.101832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.102101 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.102234 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.102365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.102365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.102636 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.102903 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.103042 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.103165 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.103284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.103422 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.103576 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.103775 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.103934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.104142 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.104277 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.104407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.104536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.104536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.104803 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.104941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.105174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.105174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.105437 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.105657 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.105795 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.105935 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.106067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.106199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.106199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.106199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.106583 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.106715 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.106862 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107154 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107302 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 04:44:46.107660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.107660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.108587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.108587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.108587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.108587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.108587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.109212 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.109212 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.109479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.109610 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.109920 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.110241 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.110547 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.112671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.113020 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.113349 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.113688 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.114188 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.114451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.114772 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.115127 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.115464 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.115778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.116092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.116661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.116797 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.117002 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.117332 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.117645 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.117963 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.118279 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.118592 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.118918 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.119228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.119558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.119865 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.120192 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.120509 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.120834 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.121159 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.121467 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.121799 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.122113 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.122422 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.122731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.123095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.123845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.124086 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.124373 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.124711 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.125131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.125419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.125697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.126028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.127044 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.127850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.128196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.128500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.128668 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_db.sqlalchemy.engines [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:44:46.128850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.129119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.129432 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.129763 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.130060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.130380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.130689 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.131039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.131330 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.131658 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.131972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.132565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.132881 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.133191 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.133500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.133808 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.134157 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.134466 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.134817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.135151 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.135533 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.135810 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.136125 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.136456 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.136779 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.137102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.137423 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.137745 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.138065 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.138385 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.138705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.139052 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.139377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.139697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.140016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.140583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.140916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.141234 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.141558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.141899 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.142735 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.143086 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.143411 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.143728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.144046 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.144366 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.144703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.145027 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.145357 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.145703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.146027 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.146354 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.146678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.147025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.147387 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.147709 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.148021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.148342 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.148664 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.148980 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.149294 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.149608 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.149927 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.150246 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.150561 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.150898 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.151222 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.151543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.151876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.152215 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.152541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.152860 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.153180 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.153505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.154028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.154346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.154685 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.155038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.155367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.155691 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.156012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.156343 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.156651 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.156961 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.157276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.158534 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.158878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.159213 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.159535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.159850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.160175 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.160491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.161030 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.161382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.161702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.162032 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.162368 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.162690 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.163025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.163356 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.163668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.163982 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.164301 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.164621 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.164928 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.165238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.165555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.165872 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.166180 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.166496 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.166817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.167153 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.167464 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.167771 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.168076 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.168389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.168698 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.169007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.169314 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.169621 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.169942 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.170248 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.170560 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.170890 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.171216 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.171525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.171842 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.172149 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.172473 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.172779 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.173142 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.174436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.174879 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.175114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.175433 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.175751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.176102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.176424 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.177018 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.177358 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.177683 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.178022 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.178359 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.178673 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.179008 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.179322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.179649 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.179966 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.180280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.180595 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.180909 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.181223 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.181537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.181854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.182166 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.182479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.182812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.183125 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.183442 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.183784 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.184105 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.184427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.184752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.185071 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.185386 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.185697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.186014 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.186327 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.186645 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.187002 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.187322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.187631 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.188059 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.188380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.188724 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.189628 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.190031 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.190291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.190628 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.190975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.191305 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.191624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.191963 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.192315 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.192469 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.context [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a(cell1) {{(pid=123368) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 04:44:46.192650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.192982 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.193294 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.193605 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.193915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.194228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.194563 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.194924 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.195244 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.195571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.195886 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.196212 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.196524 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.196764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:44:46.196929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.197162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.197482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.197797 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.198132 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:44:46.198291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.198435 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.198748 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.198980 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:44:46.199091 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.199389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.199703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.200016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.200350 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.200677 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.200923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:44:46.201031 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.201300 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.201619 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.201948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.202267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.202580 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.202934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.203254 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.203576 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.203895 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.204213 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.205062 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.205393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.205730 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.206074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.206418 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.207013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.207372 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.207692 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.208045 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.208380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.208699 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.209013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.209326 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:44:46.209574 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 04:44:46.211441 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_db.sqlalchemy.engines [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:44:46.214376 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_db.sqlalchemy.engines [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:44:46.233028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_db.sqlalchemy.engines [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:44:46.300227 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.context [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a(cell1) {{(pid=123367) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 04:44:46.304544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:44:46.306506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:44:46.307364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:44:46.309308 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:44:46.320720 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_db.sqlalchemy.engines [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:44:46.321616 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_db.sqlalchemy.engines [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:44:46.373278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_db.sqlalchemy.engines [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:44:46.491314 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_db.sqlalchemy.engines [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:44:46.688574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: WARNING keystonemiddleware.auth_token [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 04:44:46.695392 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: WARNING keystonemiddleware.auth_token [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 04:44:46.821531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: WARNING keystonemiddleware.auth_token [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 04:44:46.828455 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: WARNING keystonemiddleware.auth_token [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 04:44:47.031563 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: WARNING keystonemiddleware.auth_token [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 04:44:47.037413 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: WARNING keystonemiddleware.auth_token [None req-7f79f0c2-0167-4ce6-9334-dbefdff3e3d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 04:44:47.042583 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55872df8b9c0 pid: 123368 (default app) Jan 31 04:44:47.179406 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: WARNING keystonemiddleware.auth_token [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 04:44:47.184577 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: WARNING keystonemiddleware.auth_token [None req-cfe61fa1-e218-4c12-b474-b5c68fa1725a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 04:44:47.190562 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55872df8b9c0 pid: 123367 (default app) Jan 31 04:45:22.273494 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c9fe545a-5c9c-4cc4-8cba-964ebb61a7e9 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Action: 'create', calling method: .version_select at 0x7f69f6a5dc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1404414004", "metadata": {"Type": "work"}}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:22.275067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c9fe545a-5c9c-4cc4-8cba-964ebb61a7e9 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:22.275982 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c9fe545a-5c9c-4cc4-8cba-964ebb61a7e9 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.293406 Jan 31 04:45:22.276867 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 1/1] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Jan 31 04:45:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 31 04:45:22.290241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d0a870f0-0765-42e3-80aa-8733aa285dc2 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Action: 'create', calling method: .version_select at 0x7f69f694d790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-587843604", "metadata": {"Type": "work"}}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:22.296491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d0a870f0-0765-42e3-80aa-8733aa285dc2 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:22.296491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d0a870f0-0765-42e3-80aa-8733aa285dc2 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009180 Jan 31 04:45:22.296491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 2/2] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Jan 31 04:45:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 31 04:45:22.306524 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6acf1ea6-543d-4ce4-8a90-7945516bda23 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Action: 'create', calling method: .version_select at 0x7f69f6a5dca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1629010140", "metadata": {"Type": "work"}}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:22.308401 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6acf1ea6-543d-4ce4-8a90-7945516bda23 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:22.309664 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6acf1ea6-543d-4ce4-8a90-7945516bda23 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007595 Jan 31 04:45:22.311532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 3/3] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Jan 31 04:45:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 04:45:22.329362 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-92228392-ea22-466e-ba5a-7438a097c7dd tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Calling method '.version_select at 0x7f69f69d0280>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:22.926191 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d1cb70f6-8abb-4a4b-b6be-fa6cbe9de13f tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Action: 'create', calling method: .version_select at 0x7f69f6a5dc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1239829498"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:22.964106 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-92228392-ea22-466e-ba5a-7438a097c7dd tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] HTTP exception thrown: Volume tempest-invalid-1902063395 could not be found. Jan 31 04:45:22.965177 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-92228392-ea22-466e-ba5a-7438a097c7dd tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Returning 404 to user: Volume tempest-invalid-1902063395 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:22.966288 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-92228392-ea22-466e-ba5a-7438a097c7dd tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1902063395" status: 404 len: 99 microversion: 2.1 time: 0.643251 Jan 31 04:45:22.972046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 4/4] 10.222.0.21 () {58 vars in 1217 bytes} [Mon Jan 31 04:45:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1902063395 => generated 99 bytes in 649 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 31 04:45:22.979422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-aeb064e5-0f1c-4576-abe8-76c2161b9419 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004499 Jan 31 04:45:22.979422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 5/5] 10.222.0.21 () {58 vars in 1139 bytes} [Mon Jan 31 04:45:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 31 04:45:22.988715 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9bee4228-bbea-4b3a-9710-dc988de89848 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004568 Jan 31 04:45:22.994184 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 6/6] 10.222.0.21 () {58 vars in 1136 bytes} [Mon Jan 31 04:45:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 31 04:45:23.006921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-aca96b41-d132-4dd2-ae13-14222f5e0c27 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Calling method '.version_select at 0x7f69f6ebc550>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:23.029002 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-aca96b41-d132-4dd2-ae13-14222f5e0c27 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] HTTP exception thrown: Volume 1dba766c-8530-4420-ba38-e653d6ec1324 could not be found. Jan 31 04:45:23.029529 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-aca96b41-d132-4dd2-ae13-14222f5e0c27 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Returning 404 to user: Volume 1dba766c-8530-4420-ba38-e653d6ec1324 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:23.038031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-aca96b41-d132-4dd2-ae13-14222f5e0c27 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/1dba766c-8530-4420-ba38-e653d6ec1324" status: 404 len: 109 microversion: 2.1 time: 0.034653 Jan 31 04:45:23.038031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 7/7] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Jan 31 04:45:22 2022] DELETE /compute/v2.1/os-volumes/1dba766c-8530-4420-ba38-e653d6ec1324 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:45:23.043283 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-51599893-a4c7-4875-bf77-6b8745ad7b34 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Calling method '.version_select at 0x7f69f68c74c0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:23.099996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-51599893-a4c7-4875-bf77-6b8745ad7b34 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] HTTP exception thrown: Volume 649ff5ca-81a0-4833-86a6-1c03ddd3fe14 could not be found. Jan 31 04:45:23.100603 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-51599893-a4c7-4875-bf77-6b8745ad7b34 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] Returning 404 to user: Volume 649ff5ca-81a0-4833-86a6-1c03ddd3fe14 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:23.101404 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-51599893-a4c7-4875-bf77-6b8745ad7b34 tempest-VolumesNegativeTest-2038885787 tempest-VolumesNegativeTest-2038885787-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/649ff5ca-81a0-4833-86a6-1c03ddd3fe14" status: 404 len: 109 microversion: 2.1 time: 0.061790 Jan 31 04:45:23.102095 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 8/8] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:23 2022] GET /compute/v2.1/os-volumes/649ff5ca-81a0-4833-86a6-1c03ddd3fe14 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 04:45:24.555470 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d1cb70f6-8abb-4a4b-b6be-fa6cbe9de13f tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.463610 Jan 31 04:45:24.556123 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 1/9] 10.222.0.21 () {60 vars in 1154 bytes} [Mon Jan 31 04:45:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2466 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 31 04:45:24.569590 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4cf8a821-9055-4043-94a9-4df5d2eb0c18 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f68bab80>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:24.746307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4cf8a821-9055-4043-94a9-4df5d2eb0c18 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712" status: 200 len: 345 microversion: 2.1 time: 0.181219 Jan 31 04:45:24.747036 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 9/10] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:24 2022] GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712 => generated 345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:25.159790 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-98791284", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "ba0b9841-27aa-49a6-bb74-8529ab955193"}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:25.322427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] validate_networks() for [('ba0b9841-27aa-49a6-bb74-8529ab955193', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:45:25.511015 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1545723704", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "58128fc4-bc4f-417c-908e-383736354847"}]}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:25.793799 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] validate_networks() for [('58128fc4-bc4f-417c-908e-383736354847', None, None, None, None, None)] {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:45:26.607501 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:45:26.608017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:45:26.608497 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:45:26.609578 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:45:26.609975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:45:26.630726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:26.631445 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:26.632254 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:26.632747 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:26.664556 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Getting quotas for project 3cc69e55b9254a6ba45b32be8fc0df66. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:45:26.672050 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Getting quotas for user b07cb89be4584e6b97df973c88daa6c5 and project 3cc69e55b9254a6ba45b32be8fc0df66. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:45:26.686707 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:45:26.689251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:45:26.880393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4df0e5f7-2d21-4101-a583-832e339a4e84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.183687 Jan 31 04:45:26.888495 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 2/11] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 04:45:26.895353 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bfbfb191-8d80-4060-b0f7-9170b85b9687 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f5fc14c0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:26.952033 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bfbfb191-8d80-4060-b0f7-9170b85b9687 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712" status: 200 len: 346 microversion: 2.1 time: 0.061610 Jan 31 04:45:26.952950 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 3/12] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:26 2022] GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:26.964363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-484d1e48-27cf-4855-8714-ad96e5946292 tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f5fd90d0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:27.029988 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-484d1e48-27cf-4855-8714-ad96e5946292 tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/c0d600cb-c02a-4a74-b642-80a242c877ff" status: 200 len: 351 microversion: 2.1 time: 0.069737 Jan 31 04:45:27.032060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 4/13] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:26 2022] GET /compute/v2.1/os-volumes/c0d600cb-c02a-4a74-b642-80a242c877ff => generated 351 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:27.036891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3f77b7fa-1d8d-4884-850a-a1c95a7c9b5e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:27.044832 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3f77b7fa-1d8d-4884-850a-a1c95a7c9b5e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:27.248457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:45:27.250130 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:45:27.250991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:45:27.251716 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:45:27.252354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:45:27.271328 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:27.272332 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:27.273468 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:27.274194 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:27.282485 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3f77b7fa-1d8d-4884-850a-a1c95a7c9b5e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:27.300607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3f77b7fa-1d8d-4884-850a-a1c95a7c9b5e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1213 microversion: 2.1 time: 0.267163 Jan 31 04:45:27.308000 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 5/14] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:27 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1213 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:27.315893 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e37f1097-28c1-4480-a1ae-2b026b8dfaca tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Action: 'create', calling method: .version_select at 0x7f69f5fd99d0>, body: {"snapshot": {"volume_id": "dfeac80e-81f7-4aa5-8531-ec821d7ed712", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1605079628"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:27.351126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Getting quotas for project 41828fbc91c740cfbec65e04e92a4ecc. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:45:27.369998 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Getting quotas for user 6a6f7f126c2a4cbe80f029f352c4cafd and project 41828fbc91c740cfbec65e04e92a4ecc. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:45:27.398269 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:45:27.401114 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:45:27.737037 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ccae4064-16a3-40c6-bfd6-d0bd1afa4bf8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.678122 Jan 31 04:45:27.738405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 10/15] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:45:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:45:27.749184 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-937cf11d-94e2-4dce-8eb9-a00722e84d31 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:27.753427 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-937cf11d-94e2-4dce-8eb9-a00722e84d31 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:28.039390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-937cf11d-94e2-4dce-8eb9-a00722e84d31 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:28.069549 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-937cf11d-94e2-4dce-8eb9-a00722e84d31 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1218 microversion: 2.1 time: 0.324274 Jan 31 04:45:28.076825 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 11/16] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:27 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1218 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:28.213453 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e37f1097-28c1-4480-a1ae-2b026b8dfaca tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.904275 Jan 31 04:45:28.214741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 6/17] 10.222.0.21 () {60 vars in 1161 bytes} [Mon Jan 31 04:45:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:28.224705 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-454d1c36-f816-4ea4-93d3-41ff1b940fce tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f5fe8c10>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:28.319695 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c4dfb4da-09ca-46b0-b48d-da86066dfb71 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:28.321202 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c4dfb4da-09ca-46b0-b48d-da86066dfb71 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:28.433011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-454d1c36-f816-4ea4-93d3-41ff1b940fce tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 287 microversion: 2.1 time: 0.212139 Jan 31 04:45:28.434335 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 12/18] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:28 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:45:28.444782 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e5ff2c12-f334-4046-ba02-ab4913af7284 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f577dc10>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:28.544422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e5ff2c12-f334-4046-ba02-ab4913af7284 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.103321 Jan 31 04:45:28.545313 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 13/19] 10.222.0.21 () {58 vars in 1139 bytes} [Mon Jan 31 04:45:28 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:45:28.560183 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b6d10b68-3392-454a-af58-452dafe71ec5 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f5785940>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:28.582817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c4dfb4da-09ca-46b0-b48d-da86066dfb71 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:28.599392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c4dfb4da-09ca-46b0-b48d-da86066dfb71 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1213 microversion: 2.1 time: 0.285189 Jan 31 04:45:28.607105 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 7/20] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:28 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1213 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:28.629268 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b6d10b68-3392-454a-af58-452dafe71ec5 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 287 microversion: 2.1 time: 0.073307 Jan 31 04:45:28.634910 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 14/21] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:28 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:29.092990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e3e9b2a5-3b99-4773-b34f-ed19b9b3647a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:29.094196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e3e9b2a5-3b99-4773-b34f-ed19b9b3647a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:29.223891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e3e9b2a5-3b99-4773-b34f-ed19b9b3647a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:29.240061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e3e9b2a5-3b99-4773-b34f-ed19b9b3647a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1218 microversion: 2.1 time: 0.151059 Jan 31 04:45:29.241658 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 8/22] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:29 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:29.623856 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-08e5304a-5613-4619-92b6-8a8983642a10 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:29.625234 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-08e5304a-5613-4619-92b6-8a8983642a10 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:29.652937 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e660a06d-0fff-4260-a04e-cd13e12b00b2 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f5fec820>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:29.653389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-08e5304a-5613-4619-92b6-8a8983642a10 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:29.653389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-08e5304a-5613-4619-92b6-8a8983642a10 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:29.653389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-08e5304a-5613-4619-92b6-8a8983642a10 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:29.653389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-08e5304a-5613-4619-92b6-8a8983642a10 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:29.695588 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e660a06d-0fff-4260-a04e-cd13e12b00b2 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 287 microversion: 2.1 time: 0.057836 Jan 31 04:45:29.696257 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 9/23] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:29 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:45:30.127957 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-08e5304a-5613-4619-92b6-8a8983642a10 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:30.154001 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-08e5304a-5613-4619-92b6-8a8983642a10 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1217 microversion: 2.1 time: 0.536182 Jan 31 04:45:30.165896 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 15/24] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:29 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1217 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:30.219438 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-83083763-4f78-42f2-a91d-b3dfc03b8cfc tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f5781310>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:30.258812 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9794b7f8-0966-4714-949d-41fac20d318b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:30.259760 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9794b7f8-0966-4714-949d-41fac20d318b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:30.283450 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9794b7f8-0966-4714-949d-41fac20d318b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:30.283905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9794b7f8-0966-4714-949d-41fac20d318b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:30.289141 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9794b7f8-0966-4714-949d-41fac20d318b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:30.289383 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9794b7f8-0966-4714-949d-41fac20d318b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:30.339296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-83083763-4f78-42f2-a91d-b3dfc03b8cfc tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/64871af9-a759-483e-a2b2-373431c95ca3" status: 200 len: 350 microversion: 2.1 time: 0.124336 Jan 31 04:45:30.340239 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 10/25] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:30 2022] GET /compute/v2.1/os-volumes/64871af9-a759-483e-a2b2-373431c95ca3 => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:30.444223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9794b7f8-0966-4714-949d-41fac20d318b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:30.458907 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9794b7f8-0966-4714-949d-41fac20d318b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1222 microversion: 2.1 time: 0.203756 Jan 31 04:45:30.459727 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 16/26] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:30 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:30.707594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-91e6551f-02e0-4059-8127-d7dc6a7d1328 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f5fecd30>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:30.751179 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-91e6551f-02e0-4059-8127-d7dc6a7d1328 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 287 microversion: 2.1 time: 0.047014 Jan 31 04:45:30.751758 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 11/27] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:30 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:31.183615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-15f621b6-9ea7-472b-a0fa-113c3cf5bba4 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:31.184304 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-15f621b6-9ea7-472b-a0fa-113c3cf5bba4 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:31.192874 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-15f621b6-9ea7-472b-a0fa-113c3cf5bba4 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:31.193928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-15f621b6-9ea7-472b-a0fa-113c3cf5bba4 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:31.195327 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-15f621b6-9ea7-472b-a0fa-113c3cf5bba4 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:31.196013 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-15f621b6-9ea7-472b-a0fa-113c3cf5bba4 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:31.377911 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-15f621b6-9ea7-472b-a0fa-113c3cf5bba4 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:31.394887 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-15f621b6-9ea7-472b-a0fa-113c3cf5bba4 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1217 microversion: 2.1 time: 0.213133 Jan 31 04:45:31.409192 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 17/28] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:31 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:31.477223 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-349d6d53-72aa-4995-bea0-e2116d661a61 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:31.477846 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-349d6d53-72aa-4995-bea0-e2116d661a61 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:31.487102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-349d6d53-72aa-4995-bea0-e2116d661a61 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:31.487653 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-349d6d53-72aa-4995-bea0-e2116d661a61 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:31.488577 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-349d6d53-72aa-4995-bea0-e2116d661a61 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:31.489124 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-349d6d53-72aa-4995-bea0-e2116d661a61 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:31.731876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-349d6d53-72aa-4995-bea0-e2116d661a61 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:31.762400 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-349d6d53-72aa-4995-bea0-e2116d661a61 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1222 microversion: 2.1 time: 0.288622 Jan 31 04:45:31.763097 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-183ea50c-1008-4953-8b04-40c3177af220 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56bc670>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:31.773770 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 12/29] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:31 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:31.813867 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-183ea50c-1008-4953-8b04-40c3177af220 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 287 microversion: 2.1 time: 0.046750 Jan 31 04:45:31.813867 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 18/30] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:31 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:32.639975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-deb1bb5f-f10f-4935-a6e9-fdda05ee8da6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:32.639975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-deb1bb5f-f10f-4935-a6e9-fdda05ee8da6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:32.639975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-deb1bb5f-f10f-4935-a6e9-fdda05ee8da6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:32.639975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-deb1bb5f-f10f-4935-a6e9-fdda05ee8da6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:32.649026 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-deb1bb5f-f10f-4935-a6e9-fdda05ee8da6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:32.649026 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-deb1bb5f-f10f-4935-a6e9-fdda05ee8da6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:32.659296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1091121564", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:32.660054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-deb1bb5f-f10f-4935-a6e9-fdda05ee8da6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:32.661006 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] validate_networks() for [('a3790ef1-f274-459b-844e-81d21ffa0cc3', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:45:32.661871 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-deb1bb5f-f10f-4935-a6e9-fdda05ee8da6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1217 microversion: 2.1 time: 0.172296 Jan 31 04:45:32.661871 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 19/31] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:32 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:32.866151 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d7d90aba-9ee7-4197-aa02-439168faee2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'create', calling method: .version_select at 0x7f69f6884280>, body: {"keypair": {"name": "tempest-keypair-651864345"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:32.895055 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-d7d90aba-9ee7-4197-aa02-439168faee2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for project 3951fb700ad04745afa04a4b077da951. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:45:32.911831 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-d7d90aba-9ee7-4197-aa02-439168faee2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for user aa68ebb7220c4e6383128947fc970877 and project 3951fb700ad04745afa04a4b077da951. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:45:33.213653 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-d7d90aba-9ee7-4197-aa02-439168faee2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for project 3951fb700ad04745afa04a4b077da951. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:45:33.219157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-d7d90aba-9ee7-4197-aa02-439168faee2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for user aa68ebb7220c4e6383128947fc970877 and project 3951fb700ad04745afa04a4b077da951. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:45:33.241687 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d7d90aba-9ee7-4197-aa02-439168faee2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.657984 Jan 31 04:45:33.249772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 20/32] 10.222.0.21 () {62 vars in 1198 bytes} [Mon Jan 31 04:45:32 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 667 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 31 04:45:33.256320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cf0fa9aa-b803-4a1b-9220-0d3e06155257 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:33.258941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cf0fa9aa-b803-4a1b-9220-0d3e06155257 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:33.268497 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cf0fa9aa-b803-4a1b-9220-0d3e06155257 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:33.270498 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cf0fa9aa-b803-4a1b-9220-0d3e06155257 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:33.270498 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cf0fa9aa-b803-4a1b-9220-0d3e06155257 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:33.270931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cf0fa9aa-b803-4a1b-9220-0d3e06155257 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:33.363457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cf0fa9aa-b803-4a1b-9220-0d3e06155257 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:33.378027 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cf0fa9aa-b803-4a1b-9220-0d3e06155257 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1222 microversion: 2.1 time: 0.123056 Jan 31 04:45:33.379568 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 21/33] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:33 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:33.399768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-02dd4f59-07d3-4d79-876e-0d92c2a4714b tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56d8e50>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:33.408288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:45:33.408985 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:45:33.409998 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:45:33.410749 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:45:33.411408 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:45:33.422451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:33.422943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:33.428061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:33.428061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:33.462943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Getting quotas for project a785b6652097442291512fdd26f966ee. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:45:33.468346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Getting quotas for user 25740a911eb440c2a81d4dbcbba95c99 and project a785b6652097442291512fdd26f966ee. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:45:33.494674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:45:33.497706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:45:33.513161 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-02dd4f59-07d3-4d79-876e-0d92c2a4714b tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 287 microversion: 2.1 time: 0.132239 Jan 31 04:45:33.513729 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 22/34] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:33 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:33.602101 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8fd472aa-b126-48e0-9cd4-d9705585d009 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:33.602726 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8fd472aa-b126-48e0-9cd4-d9705585d009 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:33.608775 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8fd472aa-b126-48e0-9cd4-d9705585d009 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:33.609228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8fd472aa-b126-48e0-9cd4-d9705585d009 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:33.610004 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8fd472aa-b126-48e0-9cd4-d9705585d009 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:33.610435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8fd472aa-b126-48e0-9cd4-d9705585d009 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:33.663171 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cc6d047c-5ec2-4fd4-bfad-eaef5fca9e58 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.731915 Jan 31 04:45:33.669434 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 13/35] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:45:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:45:33.674573 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3c659012-1ddb-473b-86f6-96e30e0a5e2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:33.675425 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3c659012-1ddb-473b-86f6-96e30e0a5e2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:33.788072 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3c659012-1ddb-473b-86f6-96e30e0a5e2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:33.808121 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3c659012-1ddb-473b-86f6-96e30e0a5e2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1222 microversion: 2.1 time: 0.137461 Jan 31 04:45:33.814218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 14/36] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:33 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:33.912196 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8fd472aa-b126-48e0-9cd4-d9705585d009 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:33.921526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8fd472aa-b126-48e0-9cd4-d9705585d009 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1217 microversion: 2.1 time: 0.324523 Jan 31 04:45:33.932672 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 23/37] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:33 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1217 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:33.981168 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-308834175", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:34.042242 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] validate_networks() for [('a3790ef1-f274-459b-844e-81d21ffa0cc3', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:45:34.397935 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-60a1e8a9-94f1-460c-a5dc-0114fa9276cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:34.398536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-60a1e8a9-94f1-460c-a5dc-0114fa9276cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:34.417677 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60a1e8a9-94f1-460c-a5dc-0114fa9276cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:34.418163 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60a1e8a9-94f1-460c-a5dc-0114fa9276cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:34.425216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60a1e8a9-94f1-460c-a5dc-0114fa9276cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:34.438334 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60a1e8a9-94f1-460c-a5dc-0114fa9276cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:34.537117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-60a1e8a9-94f1-460c-a5dc-0114fa9276cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:34.561270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-60a1e8a9-94f1-460c-a5dc-0114fa9276cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1222 microversion: 2.1 time: 0.163220 Jan 31 04:45:34.565736 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 24/38] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:34 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:34.585511 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1c83111e-9aa7-4513-b5d3-356066867151 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f57288b0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:34.659343 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1c83111e-9aa7-4513-b5d3-356066867151 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 287 microversion: 2.1 time: 0.092241 Jan 31 04:45:34.663859 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 25/39] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:34 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:34.811885 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:45:34.812956 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:45:34.813634 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:45:34.814190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:45:34.814737 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:45:34.824787 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:34.825428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:34.826427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:34.827906 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:34.849161 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Getting quotas for project a785b6652097442291512fdd26f966ee. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:45:34.854597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Getting quotas for user 25740a911eb440c2a81d4dbcbba95c99 and project a785b6652097442291512fdd26f966ee. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:45:34.879095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:45:34.891440 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:45:34.954307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d94c156c-5f2d-4242-ba68-f145e83fe504 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:34.957629 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d94c156c-5f2d-4242-ba68-f145e83fe504 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:34.974540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d94c156c-5f2d-4242-ba68-f145e83fe504 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:34.975034 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d94c156c-5f2d-4242-ba68-f145e83fe504 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:34.984104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d94c156c-5f2d-4242-ba68-f145e83fe504 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:34.989315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d94c156c-5f2d-4242-ba68-f145e83fe504 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:35.063077 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-40075313-612c-4c7b-a56d-914268ed8ff9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.082250 Jan 31 04:45:35.063762 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d94c156c-5f2d-4242-ba68-f145e83fe504 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:35.068138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 15/40] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:45:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:45:35.071863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d94c156c-5f2d-4242-ba68-f145e83fe504 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1217 microversion: 2.1 time: 0.127779 Jan 31 04:45:35.083347 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 26/41] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:34 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:35.088222 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-366a74c0-edfb-43ea-a68e-ef30a3e018cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:35.091458 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-366a74c0-edfb-43ea-a68e-ef30a3e018cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:35.175305 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-366a74c0-edfb-43ea-a68e-ef30a3e018cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:35.183087 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-366a74c0-edfb-43ea-a68e-ef30a3e018cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1221 microversion: 2.1 time: 0.109715 Jan 31 04:45:35.185174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 16/42] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:35 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:35.582565 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-617b8767-5f21-4d06-8620-7691b436dea1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:35.583584 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-617b8767-5f21-4d06-8620-7691b436dea1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:35.603833 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-617b8767-5f21-4d06-8620-7691b436dea1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:35.610076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-617b8767-5f21-4d06-8620-7691b436dea1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:35.611611 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-617b8767-5f21-4d06-8620-7691b436dea1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:35.612510 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-617b8767-5f21-4d06-8620-7691b436dea1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:35.676213 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b1e5de0e-ba2b-4a58-85a1-009628bac051 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56ff670>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:35.768445 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b1e5de0e-ba2b-4a58-85a1-009628bac051 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 288 microversion: 2.1 time: 0.098989 Jan 31 04:45:35.770028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 17/43] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:35 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:35.793239 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1c3728b4-4cc5-484f-8876-2104567c3582 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56c20d0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:35.836258 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-617b8767-5f21-4d06-8620-7691b436dea1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:35.857646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-617b8767-5f21-4d06-8620-7691b436dea1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1214 microversion: 2.1 time: 0.281296 Jan 31 04:45:35.863672 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 27/44] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:35 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1214 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:35.985252 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1c3728b4-4cc5-484f-8876-2104567c3582 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "DELETE /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 202 len: 0 microversion: 2.1 time: 0.203045 Jan 31 04:45:35.986386 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 18/45] 10.222.0.21 () {58 vars in 1253 bytes} [Mon Jan 31 04:45:35 2022] DELETE /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:45:35.994358 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b2baa845-a5d6-4b05-8c16-634be0579a95 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56d8af0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:36.041098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b2baa845-a5d6-4b05-8c16-634be0579a95 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 200 len: 287 microversion: 2.1 time: 0.050306 Jan 31 04:45:36.042189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 28/46] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:35 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:36.091991 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-eed402da-fb7b-4010-a927-f3bd733a0e01 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:36.094071 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-eed402da-fb7b-4010-a927-f3bd733a0e01 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:36.102548 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eed402da-fb7b-4010-a927-f3bd733a0e01 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:36.103302 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eed402da-fb7b-4010-a927-f3bd733a0e01 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:36.105246 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eed402da-fb7b-4010-a927-f3bd733a0e01 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:36.105691 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eed402da-fb7b-4010-a927-f3bd733a0e01 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:36.206651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e4f5dfc1-787f-4137-98ef-eff61e0cc87a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:36.207520 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e4f5dfc1-787f-4137-98ef-eff61e0cc87a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:36.234174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-eed402da-fb7b-4010-a927-f3bd733a0e01 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:36.259504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-eed402da-fb7b-4010-a927-f3bd733a0e01 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1209 microversion: 2.1 time: 0.165129 Jan 31 04:45:36.260864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 19/47] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:36 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1209 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:36.333574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e4f5dfc1-787f-4137-98ef-eff61e0cc87a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:36.365944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e4f5dfc1-787f-4137-98ef-eff61e0cc87a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1221 microversion: 2.1 time: 0.147970 Jan 31 04:45:36.365944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 29/48] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:36 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:36.643715 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1e0126b0-8769-49f3-8c95-7dc42bbe7b4e tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f56ffaf0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:36.715680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1e0126b0-8769-49f3-8c95-7dc42bbe7b4e tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/645f3485-c2d2-4356-9ad6-c008ef4b6aaf" status: 200 len: 351 microversion: 2.1 time: 0.076105 Jan 31 04:45:36.717407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 20/49] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:36 2022] GET /compute/v2.1/os-volumes/645f3485-c2d2-4356-9ad6-c008ef4b6aaf => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:36.731724 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d60d3b00-6db1-43a1-8616-9e7c0d80961c tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f56bc1f0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:36.894074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f414baa3-8a13-4095-9640-0be6fb0fac55 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:36.894074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f414baa3-8a13-4095-9640-0be6fb0fac55 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:36.900764 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f414baa3-8a13-4095-9640-0be6fb0fac55 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:36.902415 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f414baa3-8a13-4095-9640-0be6fb0fac55 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:36.908072 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f414baa3-8a13-4095-9640-0be6fb0fac55 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:36.908638 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f414baa3-8a13-4095-9640-0be6fb0fac55 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:36.914127 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d60d3b00-6db1-43a1-8616-9e7c0d80961c tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.188170 Jan 31 04:45:36.914701 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 30/50] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Jan 31 04:45:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:36.933199 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-be7ae7dd-62c5-4f15-abaf-5f55cc572e0e tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f56d8ca0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:37.125170 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f414baa3-8a13-4095-9640-0be6fb0fac55 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:37.134291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f414baa3-8a13-4095-9640-0be6fb0fac55 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1214 microversion: 2.1 time: 0.247367 Jan 31 04:45:37.158343 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 21/51] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:36 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:37.171827 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-93851842-f786-4856-a7d9-375d281adec9 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56fff70>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:37.184674 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-be7ae7dd-62c5-4f15-abaf-5f55cc572e0e tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.259088 Jan 31 04:45:37.186260 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 31/52] 10.222.0.21 () {58 vars in 1148 bytes} [Mon Jan 31 04:45:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:37.198313 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3a0e88b7-438a-499f-9dc2-45c4c7fee0bc tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f5785820>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:37.352282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3a0e88b7-438a-499f-9dc2-45c4c7fee0bc tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.157865 Jan 31 04:45:37.353804 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 32/53] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Jan 31 04:45:37 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:37.375977 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-86aaf33b-5f07-468d-8504-cd691c684b43 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:37.376740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-86aaf33b-5f07-468d-8504-cd691c684b43 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:37.377388 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-93851842-f786-4856-a7d9-375d281adec9 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] HTTP exception thrown: Snapshot 24847b20-8301-4926-83fe-30622252cab7 could not be found. Jan 31 04:45:37.378158 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-93851842-f786-4856-a7d9-375d281adec9 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Returning 404 to user: Snapshot 24847b20-8301-4926-83fe-30622252cab7 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:37.379274 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-93851842-f786-4856-a7d9-375d281adec9 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7" status: 404 len: 111 microversion: 2.1 time: 0.219891 Jan 31 04:45:37.383918 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 22/54] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Jan 31 04:45:37 2022] GET /compute/v2.1/os-snapshots/24847b20-8301-4926-83fe-30622252cab7 => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:45:37.388240 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-86aaf33b-5f07-468d-8504-cd691c684b43 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:37.389204 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-86aaf33b-5f07-468d-8504-cd691c684b43 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:37.390831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e4cc32af-6fcc-4cfd-b669-94022c8dbeb1 tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f6834dc0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:37.392428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-86aaf33b-5f07-468d-8504-cd691c684b43 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:37.393125 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-86aaf33b-5f07-468d-8504-cd691c684b43 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:37.512661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e4cc32af-6fcc-4cfd-b669-94022c8dbeb1 tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.127489 Jan 31 04:45:37.517828 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-86aaf33b-5f07-468d-8504-cd691c684b43 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:37.520556 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 23/55] 10.222.0.21 () {58 vars in 1166 bytes} [Mon Jan 31 04:45:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:37.526449 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-19f8443a-6dfe-4aa6-9e34-bc17898f011a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:37.528457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-86aaf33b-5f07-468d-8504-cd691c684b43 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1283 microversion: 2.1 time: 0.171671 Jan 31 04:45:37.528457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 33/56] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:37 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:37.533494 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-19f8443a-6dfe-4aa6-9e34-bc17898f011a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:37.533617 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-84690a79-2269-4ad4-8a59-111b9c692a18 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f571b1f0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:37.552451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-19f8443a-6dfe-4aa6-9e34-bc17898f011a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:37.553163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-19f8443a-6dfe-4aa6-9e34-bc17898f011a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:37.555265 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-19f8443a-6dfe-4aa6-9e34-bc17898f011a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:37.555964 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-19f8443a-6dfe-4aa6-9e34-bc17898f011a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:37.804546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-84690a79-2269-4ad4-8a59-111b9c692a18 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712" status: 202 len: 0 microversion: 2.1 time: 0.275975 Jan 31 04:45:37.812417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 34/57] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Jan 31 04:45:37 2022] DELETE /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:45:37.812417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2a83395e-756a-462a-b87b-52e83e3118c2 tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f56c89d0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:37.953752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-19f8443a-6dfe-4aa6-9e34-bc17898f011a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:37.963579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-19f8443a-6dfe-4aa6-9e34-bc17898f011a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1273 microversion: 2.1 time: 0.441759 Jan 31 04:45:37.972429 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 24/58] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:37 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1273 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:37.999048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-39ab1e74-44b0-404e-94b1-6925e6bcb385 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56c2160>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:38.088740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2a83395e-756a-462a-b87b-52e83e3118c2 tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.281473 Jan 31 04:45:38.090812 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 35/59] 10.222.0.21 () {58 vars in 1169 bytes} [Mon Jan 31 04:45:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:38.102366 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cfbf09a7-da2b-4d30-98e8-919ded5ea683 tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f56c88b0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:38.226653 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-39ab1e74-44b0-404e-94b1-6925e6bcb385 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712" status: 200 len: 345 microversion: 2.1 time: 0.252972 Jan 31 04:45:38.227789 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 25/60] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:37 2022] GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712 => generated 345 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:38.232461 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-92b08835-b493-4f03-921d-ddec4f634e1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:38.233441 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-92b08835-b493-4f03-921d-ddec4f634e1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:38.253468 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92b08835-b493-4f03-921d-ddec4f634e1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:38.255213 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92b08835-b493-4f03-921d-ddec4f634e1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:38.256853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92b08835-b493-4f03-921d-ddec4f634e1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:38.262002 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92b08835-b493-4f03-921d-ddec4f634e1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:38.477655 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cfbf09a7-da2b-4d30-98e8-919ded5ea683 tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.379165 Jan 31 04:45:38.478334 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 36/61] 10.222.0.21 () {58 vars in 1154 bytes} [Mon Jan 31 04:45:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:38.483963 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1481617915", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a3d49fc-fe05-4677-aa28-3de849a9cd8b"}], "security_groups": [{"name": "tempest-securitygroup--491233204"}], "key_name": "tempest-keypair-651864345", "user_data": "}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:38.586048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-92b08835-b493-4f03-921d-ddec4f634e1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:38.597817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-92b08835-b493-4f03-921d-ddec4f634e1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1270 microversion: 2.1 time: 0.366040 Jan 31 04:45:38.598592 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 26/62] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:38 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1270 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:38.606537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-57f07177-399a-47ed-9f8b-b790801e015e tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f5718280>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:38.739175 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] validate_networks() for [('6a3d49fc-fe05-4677-aa28-3de849a9cd8b', None, None, None, None, None)] {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:45:38.796541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-57f07177-399a-47ed-9f8b-b790801e015e tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.194181 Jan 31 04:45:38.797799 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 27/63] 10.222.0.21 () {58 vars in 1187 bytes} [Mon Jan 31 04:45:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:38.823657 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d3581eca-9254-4bd1-9224-5045c78ca9ee tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:38.824386 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d3581eca-9254-4bd1-9224-5045c78ca9ee tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:38.835293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d3581eca-9254-4bd1-9224-5045c78ca9ee tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:38.837660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d3581eca-9254-4bd1-9224-5045c78ca9ee tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:38.838603 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d3581eca-9254-4bd1-9224-5045c78ca9ee tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:38.839346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d3581eca-9254-4bd1-9224-5045c78ca9ee tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:38.973248 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d3581eca-9254-4bd1-9224-5045c78ca9ee tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:38.981324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d3581eca-9254-4bd1-9224-5045c78ca9ee tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1271 microversion: 2.1 time: 0.182453 Jan 31 04:45:38.983967 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 28/64] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:38 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:39.007702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8751e84a-0081-4a87-9790-db9ce36fc0db tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] Calling method '.version_select at 0x7f69f56ff8b0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:39.114588 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8751e84a-0081-4a87-9790-db9ce36fc0db tempest-VolumesTestJSON-1214259771 tempest-VolumesTestJSON-1214259771-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.117682 Jan 31 04:45:39.115216 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 29/65] 10.222.0.21 () {58 vars in 1154 bytes} [Mon Jan 31 04:45:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:39.119751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-00673330-3558-482c-ad15-6a591a7be579 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:39.120357 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-00673330-3558-482c-ad15-6a591a7be579 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:39.132771 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00673330-3558-482c-ad15-6a591a7be579 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:39.133228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00673330-3558-482c-ad15-6a591a7be579 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:39.134019 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00673330-3558-482c-ad15-6a591a7be579 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:39.134458 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00673330-3558-482c-ad15-6a591a7be579 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:39.287203 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-00673330-3558-482c-ad15-6a591a7be579 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:39.294749 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-00673330-3558-482c-ad15-6a591a7be579 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1279 microversion: 2.1 time: 0.178345 Jan 31 04:45:39.299547 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 30/66] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:39 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:39.310228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a6867284-eaee-4d1a-a589-410c157003e1 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56c2700>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:39.360629 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-a6867284-eaee-4d1a-a589-410c157003e1 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] HTTP exception thrown: Volume dfeac80e-81f7-4aa5-8531-ec821d7ed712 could not be found. Jan 31 04:45:39.361223 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a6867284-eaee-4d1a-a589-410c157003e1 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Returning 404 to user: Volume dfeac80e-81f7-4aa5-8531-ec821d7ed712 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:39.362055 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a6867284-eaee-4d1a-a589-410c157003e1 tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712" status: 404 len: 109 microversion: 2.1 time: 0.061412 Jan 31 04:45:39.362891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 31/67] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:39 2022] GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:45:39.378736 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5860c313-94a5-4527-a47c-5eba6661ef6d tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56d54c0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:39.428916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-5860c313-94a5-4527-a47c-5eba6661ef6d tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] HTTP exception thrown: Volume dfeac80e-81f7-4aa5-8531-ec821d7ed712 could not be found. Jan 31 04:45:39.429521 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5860c313-94a5-4527-a47c-5eba6661ef6d tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Returning 404 to user: Volume dfeac80e-81f7-4aa5-8531-ec821d7ed712 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:39.430346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5860c313-94a5-4527-a47c-5eba6661ef6d tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712" status: 404 len: 109 microversion: 2.1 time: 0.057754 Jan 31 04:45:39.430934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 32/68] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Jan 31 04:45:39 2022] DELETE /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 04:45:39.442925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6502e687-7cbf-4696-b893-d535f7b1cdda tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Calling method '.version_select at 0x7f69f56c20d0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:39.477838 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-6502e687-7cbf-4696-b893-d535f7b1cdda tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] HTTP exception thrown: Volume dfeac80e-81f7-4aa5-8531-ec821d7ed712 could not be found. Jan 31 04:45:39.478443 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6502e687-7cbf-4696-b893-d535f7b1cdda tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] Returning 404 to user: Volume dfeac80e-81f7-4aa5-8531-ec821d7ed712 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:45:39.484216 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6502e687-7cbf-4696-b893-d535f7b1cdda tempest-VolumesSnapshotsTestJSON-994594567 tempest-VolumesSnapshotsTestJSON-994594567-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712" status: 404 len: 109 microversion: 2.1 time: 0.043666 Jan 31 04:45:39.484216 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 33/69] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:45:39 2022] GET /compute/v2.1/os-volumes/dfeac80e-81f7-4aa5-8531-ec821d7ed712 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:45:39.630116 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4d30901c-8662-440e-a382-338415cce43c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:39.631126 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4d30901c-8662-440e-a382-338415cce43c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:39.643559 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d30901c-8662-440e-a382-338415cce43c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:39.644364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d30901c-8662-440e-a382-338415cce43c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:39.650406 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d30901c-8662-440e-a382-338415cce43c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:39.650406 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d30901c-8662-440e-a382-338415cce43c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:39.802561 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4d30901c-8662-440e-a382-338415cce43c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:39.814300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:45:39.815746 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:45:39.816705 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:45:39.818039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:45:39.818640 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:45:39.835319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:39.835981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:39.837172 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:39.838065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:39.839118 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4d30901c-8662-440e-a382-338415cce43c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1270 microversion: 2.1 time: 0.219465 Jan 31 04:45:39.839722 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 34/70] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:39 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:39.872718 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for project 3951fb700ad04745afa04a4b077da951. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:45:39.881489 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for user aa68ebb7220c4e6383128947fc970877 and project 3951fb700ad04745afa04a4b077da951. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:45:39.900485 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:45:39.904432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:45:40.002251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bc7ab4ef-d1bf-4965-92c6-cc50a2cdbf6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:40.003008 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bc7ab4ef-d1bf-4965-92c6-cc50a2cdbf6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:40.010532 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bc7ab4ef-d1bf-4965-92c6-cc50a2cdbf6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:40.011265 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bc7ab4ef-d1bf-4965-92c6-cc50a2cdbf6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:40.012279 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bc7ab4ef-d1bf-4965-92c6-cc50a2cdbf6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:40.012906 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bc7ab4ef-d1bf-4965-92c6-cc50a2cdbf6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:40.073308 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b4db7696-3843-4061-a76a-8b90b187cda2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.593105 Jan 31 04:45:40.074051 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 37/71] 10.222.0.21 () {62 vars in 1187 bytes} [Mon Jan 31 04:45:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 31 04:45:40.094578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f82a3b62-5801-43e7-88ad-163f83e01239 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:40.095538 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f82a3b62-5801-43e7-88ad-163f83e01239 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:40.269157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f82a3b62-5801-43e7-88ad-163f83e01239 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:40.276421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f82a3b62-5801-43e7-88ad-163f83e01239 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:40.277923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f82a3b62-5801-43e7-88ad-163f83e01239 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:40.288848 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f82a3b62-5801-43e7-88ad-163f83e01239 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1281 microversion: 2.20 time: 0.198190 Jan 31 04:45:40.291749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 38/72] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:40 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:45:40.317128 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f77e33a0-a76a-4ed5-9a80-3096e212cfbc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:40.317745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f77e33a0-a76a-4ed5-9a80-3096e212cfbc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:40.335459 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f77e33a0-a76a-4ed5-9a80-3096e212cfbc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:40.335910 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f77e33a0-a76a-4ed5-9a80-3096e212cfbc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:40.341255 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f77e33a0-a76a-4ed5-9a80-3096e212cfbc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:40.341814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f77e33a0-a76a-4ed5-9a80-3096e212cfbc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:40.433727 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f77e33a0-a76a-4ed5-9a80-3096e212cfbc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:40.443434 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f77e33a0-a76a-4ed5-9a80-3096e212cfbc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1279 microversion: 2.1 time: 0.129650 Jan 31 04:45:40.444073 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 39/73] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:40 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1279 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:40.495096 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-bc7ab4ef-d1bf-4965-92c6-cc50a2cdbf6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:40.505200 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bc7ab4ef-d1bf-4965-92c6-cc50a2cdbf6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.506905 Jan 31 04:45:40.512707 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 35/74] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:39 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:40.855572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2e24cc16-a2f2-4e88-b853-7d2ae8cf12e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:40.856329 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2e24cc16-a2f2-4e88-b853-7d2ae8cf12e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:40.863359 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2e24cc16-a2f2-4e88-b853-7d2ae8cf12e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:40.864342 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2e24cc16-a2f2-4e88-b853-7d2ae8cf12e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:40.866162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2e24cc16-a2f2-4e88-b853-7d2ae8cf12e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:40.867302 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2e24cc16-a2f2-4e88-b853-7d2ae8cf12e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:40.949846 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2e24cc16-a2f2-4e88-b853-7d2ae8cf12e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:40.962706 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2e24cc16-a2f2-4e88-b853-7d2ae8cf12e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1270 microversion: 2.1 time: 0.110925 Jan 31 04:45:40.963315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 40/75] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:40 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:41.308705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-594878de-0918-44a3-ba73-4720f5c47085 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:41.309553 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-594878de-0918-44a3-ba73-4720f5c47085 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:41.391011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-594878de-0918-44a3-ba73-4720f5c47085 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:41.398093 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-594878de-0918-44a3-ba73-4720f5c47085 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:41.400038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-594878de-0918-44a3-ba73-4720f5c47085 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:41.400764 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-594878de-0918-44a3-ba73-4720f5c47085 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1281 microversion: 2.20 time: 0.095880 Jan 31 04:45:41.401399 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 36/76] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:41 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:41.460293 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c6cdbfaf-a8fd-40cf-905d-10d5da02c1d9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:41.461526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c6cdbfaf-a8fd-40cf-905d-10d5da02c1d9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:41.468227 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c6cdbfaf-a8fd-40cf-905d-10d5da02c1d9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:41.468921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c6cdbfaf-a8fd-40cf-905d-10d5da02c1d9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:41.469933 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c6cdbfaf-a8fd-40cf-905d-10d5da02c1d9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:41.470338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c6cdbfaf-a8fd-40cf-905d-10d5da02c1d9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:41.522589 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-568ba0ba-66d7-449b-9790-48603b716216 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:41.523233 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-568ba0ba-66d7-449b-9790-48603b716216 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:41.533198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-568ba0ba-66d7-449b-9790-48603b716216 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:41.533198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-568ba0ba-66d7-449b-9790-48603b716216 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:41.533198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-568ba0ba-66d7-449b-9790-48603b716216 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:41.533198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-568ba0ba-66d7-449b-9790-48603b716216 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:41.769625 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-568ba0ba-66d7-449b-9790-48603b716216 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:41.779678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-568ba0ba-66d7-449b-9790-48603b716216 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.261005 Jan 31 04:45:41.783704 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 37/77] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:41 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:41.852536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c6cdbfaf-a8fd-40cf-905d-10d5da02c1d9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:41.860865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c6cdbfaf-a8fd-40cf-905d-10d5da02c1d9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.404213 Jan 31 04:45:41.881197 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 41/78] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:41 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:41.980138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2bd4fd50-79c9-47ea-aea8-4633676cd30b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:41.980934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2bd4fd50-79c9-47ea-aea8-4633676cd30b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:41.987471 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2bd4fd50-79c9-47ea-aea8-4633676cd30b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:41.988193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2bd4fd50-79c9-47ea-aea8-4633676cd30b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:41.989161 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2bd4fd50-79c9-47ea-aea8-4633676cd30b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:41.989806 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2bd4fd50-79c9-47ea-aea8-4633676cd30b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:42.058051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2bd4fd50-79c9-47ea-aea8-4633676cd30b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:42.066156 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2bd4fd50-79c9-47ea-aea8-4633676cd30b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1270 microversion: 2.1 time: 0.089631 Jan 31 04:45:42.066962 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 38/79] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:41 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:42.419191 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:42.419803 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:42.427319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:42.428328 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:42.429484 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:42.430028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:42.527433 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:42.541178 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:42.543465 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:42.546963 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2f297e5f-69f0-45e1-bf4e-c15c8e631977 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.129422 Jan 31 04:45:42.548163 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 42/80] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:42 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:42.799599 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f0a7ec7f-71ee-4152-ba8a-8ba1557e55fd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:42.800347 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f0a7ec7f-71ee-4152-ba8a-8ba1557e55fd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:42.807151 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f0a7ec7f-71ee-4152-ba8a-8ba1557e55fd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:42.807629 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f0a7ec7f-71ee-4152-ba8a-8ba1557e55fd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:42.808676 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f0a7ec7f-71ee-4152-ba8a-8ba1557e55fd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:42.809360 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f0a7ec7f-71ee-4152-ba8a-8ba1557e55fd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:42.877889 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-548dd7d6-bf8f-4c63-87e7-ec2430b5f4ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:42.879762 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-548dd7d6-bf8f-4c63-87e7-ec2430b5f4ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:42.887400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-548dd7d6-bf8f-4c63-87e7-ec2430b5f4ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:42.888211 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-548dd7d6-bf8f-4c63-87e7-ec2430b5f4ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:42.889077 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-548dd7d6-bf8f-4c63-87e7-ec2430b5f4ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:42.890912 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-548dd7d6-bf8f-4c63-87e7-ec2430b5f4ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:43.038415 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f0a7ec7f-71ee-4152-ba8a-8ba1557e55fd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:43.047440 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f0a7ec7f-71ee-4152-ba8a-8ba1557e55fd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.251664 Jan 31 04:45:43.048324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 39/81] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:42 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:43.100714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-77f6cfb7-4000-4837-91dc-e2ac9d3e5f6f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:43.101676 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-77f6cfb7-4000-4837-91dc-e2ac9d3e5f6f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:43.111151 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-77f6cfb7-4000-4837-91dc-e2ac9d3e5f6f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:43.112229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-548dd7d6-bf8f-4c63-87e7-ec2430b5f4ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:43.115723 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-77f6cfb7-4000-4837-91dc-e2ac9d3e5f6f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:43.119177 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-77f6cfb7-4000-4837-91dc-e2ac9d3e5f6f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:43.120725 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-77f6cfb7-4000-4837-91dc-e2ac9d3e5f6f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:43.134966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-548dd7d6-bf8f-4c63-87e7-ec2430b5f4ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.257122 Jan 31 04:45:43.136970 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 43/82] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:42 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:43.262669 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-77f6cfb7-4000-4837-91dc-e2ac9d3e5f6f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:43.277380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-77f6cfb7-4000-4837-91dc-e2ac9d3e5f6f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1278 microversion: 2.1 time: 0.192076 Jan 31 04:45:43.279282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 40/83] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:43 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:43.570720 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:43.571396 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:43.578599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:43.579134 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:43.579920 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:43.580360 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:43.697532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:43.716846 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:43.719587 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:43.721136 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5f6b3a97-98d8-4101-b5ea-e98b1006c7f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.159758 Jan 31 04:45:43.733748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 44/84] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:43 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:44.069359 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ccb8aeef-c209-4077-b803-8594c8fd0ce8 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:44.070785 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ccb8aeef-c209-4077-b803-8594c8fd0ce8 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:44.078637 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ccb8aeef-c209-4077-b803-8594c8fd0ce8 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:44.080448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ccb8aeef-c209-4077-b803-8594c8fd0ce8 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:44.082053 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ccb8aeef-c209-4077-b803-8594c8fd0ce8 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:44.082661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ccb8aeef-c209-4077-b803-8594c8fd0ce8 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:44.156026 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eeaccf77-6bb1-4d77-8763-17c0322958df tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:44.164136 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-eeaccf77-6bb1-4d77-8763-17c0322958df tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:44.179598 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eeaccf77-6bb1-4d77-8763-17c0322958df tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:44.182053 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eeaccf77-6bb1-4d77-8763-17c0322958df tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:44.192145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eeaccf77-6bb1-4d77-8763-17c0322958df tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:44.192914 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eeaccf77-6bb1-4d77-8763-17c0322958df tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:44.250671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ccb8aeef-c209-4077-b803-8594c8fd0ce8 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:44.258681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ccb8aeef-c209-4077-b803-8594c8fd0ce8 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.195419 Jan 31 04:45:44.259545 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 41/85] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:44 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:44.297849 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b6ccc737-bd66-4a3e-963f-3e41d6383b7f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:44.298876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b6ccc737-bd66-4a3e-963f-3e41d6383b7f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:44.305421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b6ccc737-bd66-4a3e-963f-3e41d6383b7f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:44.310859 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b6ccc737-bd66-4a3e-963f-3e41d6383b7f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:44.314316 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b6ccc737-bd66-4a3e-963f-3e41d6383b7f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:44.314874 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b6ccc737-bd66-4a3e-963f-3e41d6383b7f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:44.413670 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b6ccc737-bd66-4a3e-963f-3e41d6383b7f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:44.421267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b6ccc737-bd66-4a3e-963f-3e41d6383b7f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1278 microversion: 2.1 time: 0.127582 Jan 31 04:45:44.421841 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 42/86] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:44 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:44.441672 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eeaccf77-6bb1-4d77-8763-17c0322958df tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:44.460348 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-eeaccf77-6bb1-4d77-8763-17c0322958df tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.308871 Jan 31 04:45:44.462739 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 45/87] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:44 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:44.741791 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:44.742488 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:44.753798 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:44.754421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:44.755386 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:44.756404 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:44.829795 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:44.839021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:44.839817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:44.840916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8b53ed4e-adf9-4906-9f88-8ef03819620a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.102835 Jan 31 04:45:44.841845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 43/88] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:44 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:45.276737 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-10d8e98b-1247-448a-bdac-2903283138db tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:45.277358 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-10d8e98b-1247-448a-bdac-2903283138db tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:45.283493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10d8e98b-1247-448a-bdac-2903283138db tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:45.283935 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10d8e98b-1247-448a-bdac-2903283138db tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:45.284697 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10d8e98b-1247-448a-bdac-2903283138db tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:45.285178 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10d8e98b-1247-448a-bdac-2903283138db tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:45.438095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9601fe3d-572c-4304-933e-715eb230b57a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:45.438933 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9601fe3d-572c-4304-933e-715eb230b57a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:45.444735 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9601fe3d-572c-4304-933e-715eb230b57a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:45.445297 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9601fe3d-572c-4304-933e-715eb230b57a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:45.446131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9601fe3d-572c-4304-933e-715eb230b57a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:45.446752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9601fe3d-572c-4304-933e-715eb230b57a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:45.451514 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-10d8e98b-1247-448a-bdac-2903283138db tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:45.465857 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-10d8e98b-1247-448a-bdac-2903283138db tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.192838 Jan 31 04:45:45.466439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 46/89] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:45 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:45.482269 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-54512fd0-e67a-40f7-add7-bc259f15e301 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:45.482912 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-54512fd0-e67a-40f7-add7-bc259f15e301 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:45.494694 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-54512fd0-e67a-40f7-add7-bc259f15e301 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:45.495499 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-54512fd0-e67a-40f7-add7-bc259f15e301 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:45.496494 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-54512fd0-e67a-40f7-add7-bc259f15e301 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:45.497080 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-54512fd0-e67a-40f7-add7-bc259f15e301 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:45.551822 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9601fe3d-572c-4304-933e-715eb230b57a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:45.568574 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9601fe3d-572c-4304-933e-715eb230b57a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1278 microversion: 2.1 time: 0.133919 Jan 31 04:45:45.575917 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 44/90] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:45 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:45.677333 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-54512fd0-e67a-40f7-add7-bc259f15e301 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:45.690768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-54512fd0-e67a-40f7-add7-bc259f15e301 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.212423 Jan 31 04:45:45.700637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 47/91] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:45 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:45.861589 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:45.862654 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:45.869179 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:45.869915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:45.871100 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:45.871996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:45.938476 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:45.949911 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:45.954499 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:45.960783 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ca16413a-b823-493b-b0e7-bb3b7bd8d063 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.098574 Jan 31 04:45:45.960783 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 45/92] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:45 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:46.486074 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f3f6de3e-3f9d-42a6-b9bb-37662b847e4b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:46.486682 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f3f6de3e-3f9d-42a6-b9bb-37662b847e4b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:46.492626 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f3f6de3e-3f9d-42a6-b9bb-37662b847e4b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:46.493065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f3f6de3e-3f9d-42a6-b9bb-37662b847e4b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:46.494139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f3f6de3e-3f9d-42a6-b9bb-37662b847e4b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:46.494578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f3f6de3e-3f9d-42a6-b9bb-37662b847e4b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:46.599635 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7dcd13fc-5220-43f0-a55f-305fdd37ceed tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:46.600392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7dcd13fc-5220-43f0-a55f-305fdd37ceed tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:46.607760 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7dcd13fc-5220-43f0-a55f-305fdd37ceed tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:46.611858 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7dcd13fc-5220-43f0-a55f-305fdd37ceed tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:46.614348 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7dcd13fc-5220-43f0-a55f-305fdd37ceed tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:46.614980 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7dcd13fc-5220-43f0-a55f-305fdd37ceed tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:46.683794 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f3f6de3e-3f9d-42a6-b9bb-37662b847e4b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:46.700640 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f3f6de3e-3f9d-42a6-b9bb-37662b847e4b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.220302 Jan 31 04:45:46.702487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 48/93] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:46 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:46.713596 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6e629f4c-b59b-4c77-b0c3-523571eacfb2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:46.713596 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6e629f4c-b59b-4c77-b0c3-523571eacfb2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:46.716073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7dcd13fc-5220-43f0-a55f-305fdd37ceed tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:46.728626 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7dcd13fc-5220-43f0-a55f-305fdd37ceed tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1278 microversion: 2.1 time: 0.140779 Jan 31 04:45:46.729603 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 46/94] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:46 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:46.730007 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6e629f4c-b59b-4c77-b0c3-523571eacfb2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:46.730576 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6e629f4c-b59b-4c77-b0c3-523571eacfb2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:46.731493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6e629f4c-b59b-4c77-b0c3-523571eacfb2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:46.732143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6e629f4c-b59b-4c77-b0c3-523571eacfb2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:46.975751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:46.976365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:46.976762 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6e629f4c-b59b-4c77-b0c3-523571eacfb2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:46.984939 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:46.985392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:46.988061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:46.988505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:46.995238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6e629f4c-b59b-4c77-b0c3-523571eacfb2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.290356 Jan 31 04:45:46.996142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 49/95] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:46 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:47.064837 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:47.072600 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:47.076378 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:47.078069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-761bede9-b3ba-417b-90d2-29f83ab088d3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.106091 Jan 31 04:45:47.079413 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 47/96] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:46 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:45:47.724926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-72fd68d4-855c-48dd-a432-85eac5f3413c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:47.731337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-72fd68d4-855c-48dd-a432-85eac5f3413c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:47.748390 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9a69a900-bc9d-409c-941e-4fa87ebbcf4a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:47.749767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9a69a900-bc9d-409c-941e-4fa87ebbcf4a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:47.757154 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-72fd68d4-855c-48dd-a432-85eac5f3413c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:47.760146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a69a900-bc9d-409c-941e-4fa87ebbcf4a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:47.760146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a69a900-bc9d-409c-941e-4fa87ebbcf4a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:47.760721 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-72fd68d4-855c-48dd-a432-85eac5f3413c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:47.761927 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-72fd68d4-855c-48dd-a432-85eac5f3413c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:47.762711 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-72fd68d4-855c-48dd-a432-85eac5f3413c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:47.765458 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a69a900-bc9d-409c-941e-4fa87ebbcf4a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:47.766825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a69a900-bc9d-409c-941e-4fa87ebbcf4a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:47.897609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9a69a900-bc9d-409c-941e-4fa87ebbcf4a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:47.906162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9a69a900-bc9d-409c-941e-4fa87ebbcf4a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1278 microversion: 2.1 time: 0.163583 Jan 31 04:45:47.908147 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 48/97] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:47 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:48.013021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-baeb2f46-7492-418a-aa8d-13894aa05465 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:48.013625 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-baeb2f46-7492-418a-aa8d-13894aa05465 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:48.026707 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-baeb2f46-7492-418a-aa8d-13894aa05465 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:48.027174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-baeb2f46-7492-418a-aa8d-13894aa05465 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:48.027959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-baeb2f46-7492-418a-aa8d-13894aa05465 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:48.028385 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-baeb2f46-7492-418a-aa8d-13894aa05465 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:48.148114 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-72fd68d4-855c-48dd-a432-85eac5f3413c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:48.163265 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-72fd68d4-855c-48dd-a432-85eac5f3413c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.444308 Jan 31 04:45:48.164631 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 50/98] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:47 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:48.181540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:48.182385 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:48.221346 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:48.223638 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:48.226829 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:48.228501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:48.327191 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:48.337546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:48.340454 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:48.348328 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-55293800-ff3e-4c19-958c-926aedc21428 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.179307 Jan 31 04:45:48.348941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 51/99] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:48 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:48.378671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-baeb2f46-7492-418a-aa8d-13894aa05465 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:48.401304 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-baeb2f46-7492-418a-aa8d-13894aa05465 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.389625 Jan 31 04:45:48.402115 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 49/100] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:48 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:48.925171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c0aec25d-c97a-413a-8d0b-659011a234c5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:48.925842 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c0aec25d-c97a-413a-8d0b-659011a234c5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:48.932282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c0aec25d-c97a-413a-8d0b-659011a234c5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:48.932724 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c0aec25d-c97a-413a-8d0b-659011a234c5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:48.933508 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c0aec25d-c97a-413a-8d0b-659011a234c5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:48.933941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c0aec25d-c97a-413a-8d0b-659011a234c5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:49.181352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bc210319-9d4a-4f6f-bae1-d9f5c188a5bc tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:49.183191 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bc210319-9d4a-4f6f-bae1-d9f5c188a5bc tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:49.190095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bc210319-9d4a-4f6f-bae1-d9f5c188a5bc tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:49.193389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bc210319-9d4a-4f6f-bae1-d9f5c188a5bc tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:49.193389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bc210319-9d4a-4f6f-bae1-d9f5c188a5bc tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:49.193389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bc210319-9d4a-4f6f-bae1-d9f5c188a5bc tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:49.417282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c0aec25d-c97a-413a-8d0b-659011a234c5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:49.427169 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c0aec25d-c97a-413a-8d0b-659011a234c5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1278 microversion: 2.1 time: 0.505923 Jan 31 04:45:49.428508 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 52/101] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:48 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1278 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:49.433467 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:49.443799 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:49.450877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:49.451592 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:49.452590 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:49.453204 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:49.479962 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-bc210319-9d4a-4f6f-bae1-d9f5c188a5bc tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:49.491260 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bc210319-9d4a-4f6f-bae1-d9f5c188a5bc tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.313657 Jan 31 04:45:49.491927 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 50/102] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:49 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:49.505855 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5923429e-054f-426a-b2d8-5dbcb86820d4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:49.505855 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5923429e-054f-426a-b2d8-5dbcb86820d4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:49.505855 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5923429e-054f-426a-b2d8-5dbcb86820d4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:49.505855 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5923429e-054f-426a-b2d8-5dbcb86820d4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:49.506388 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5923429e-054f-426a-b2d8-5dbcb86820d4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:49.507102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5923429e-054f-426a-b2d8-5dbcb86820d4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:49.583064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:49.595509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:49.598513 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:49.601188 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-34600a4d-44e2-47fd-a4b7-39b1f7de6c15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.170878 Jan 31 04:45:49.615135 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 53/103] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:49 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:49.847332 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5923429e-054f-426a-b2d8-5dbcb86820d4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:49.868145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5923429e-054f-426a-b2d8-5dbcb86820d4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.370458 Jan 31 04:45:49.868145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 51/104] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:49 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:50.446197 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c8a4219d-cfee-4d76-b38c-ee8d900d811c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:50.446812 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c8a4219d-cfee-4d76-b38c-ee8d900d811c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:50.453062 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c8a4219d-cfee-4d76-b38c-ee8d900d811c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:50.453505 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c8a4219d-cfee-4d76-b38c-ee8d900d811c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:50.454307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c8a4219d-cfee-4d76-b38c-ee8d900d811c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:50.454729 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c8a4219d-cfee-4d76-b38c-ee8d900d811c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:50.509075 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-fcf9b188-0787-4249-a958-6d0e88f08c3d tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:50.509683 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-fcf9b188-0787-4249-a958-6d0e88f08c3d tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:50.516078 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fcf9b188-0787-4249-a958-6d0e88f08c3d tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:50.516514 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fcf9b188-0787-4249-a958-6d0e88f08c3d tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:50.519740 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fcf9b188-0787-4249-a958-6d0e88f08c3d tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:50.520252 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fcf9b188-0787-4249-a958-6d0e88f08c3d tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:50.520360 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c8a4219d-cfee-4d76-b38c-ee8d900d811c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:50.529783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c8a4219d-cfee-4d76-b38c-ee8d900d811c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1278 microversion: 2.1 time: 0.088460 Jan 31 04:45:50.530720 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 54/105] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:50 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:50.634263 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:50.635006 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:50.642405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:50.643071 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:50.645294 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:50.645785 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:50.708901 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-fcf9b188-0787-4249-a958-6d0e88f08c3d tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:50.713137 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:50.716555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-fcf9b188-0787-4249-a958-6d0e88f08c3d tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.211847 Jan 31 04:45:50.718074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 52/106] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:50 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:50.727849 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:50.729449 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:50.730477 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f9baf58a-288f-4e66-9b72-19d9e4a4b711 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.101748 Jan 31 04:45:50.731078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 55/107] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:50 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:45:50.883608 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-64a53dc6-78b8-4818-a94b-f31c577adc83 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:50.884210 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-64a53dc6-78b8-4818-a94b-f31c577adc83 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:50.890187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-64a53dc6-78b8-4818-a94b-f31c577adc83 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:50.890639 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-64a53dc6-78b8-4818-a94b-f31c577adc83 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:50.891468 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-64a53dc6-78b8-4818-a94b-f31c577adc83 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:50.891936 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-64a53dc6-78b8-4818-a94b-f31c577adc83 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:51.023999 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-64a53dc6-78b8-4818-a94b-f31c577adc83 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:51.032550 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-64a53dc6-78b8-4818-a94b-f31c577adc83 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.152879 Jan 31 04:45:51.033140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 53/108] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:50 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:51.546674 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-79951372-9cbe-48e3-8eb7-c0131d1612df tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:51.550141 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-79951372-9cbe-48e3-8eb7-c0131d1612df tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:51.553386 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-79951372-9cbe-48e3-8eb7-c0131d1612df tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:51.553823 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-79951372-9cbe-48e3-8eb7-c0131d1612df tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:51.554615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-79951372-9cbe-48e3-8eb7-c0131d1612df tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:51.555293 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-79951372-9cbe-48e3-8eb7-c0131d1612df tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:51.625872 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-79951372-9cbe-48e3-8eb7-c0131d1612df tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:51.634519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-79951372-9cbe-48e3-8eb7-c0131d1612df tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1278 microversion: 2.1 time: 0.092604 Jan 31 04:45:51.644104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 56/109] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:51 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:51.736362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-99fd09a3-78b8-4f57-8e12-6dbe3761fb03 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:51.736362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-99fd09a3-78b8-4f57-8e12-6dbe3761fb03 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:51.741503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-99fd09a3-78b8-4f57-8e12-6dbe3761fb03 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:51.741946 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-99fd09a3-78b8-4f57-8e12-6dbe3761fb03 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:51.742754 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-99fd09a3-78b8-4f57-8e12-6dbe3761fb03 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:51.743212 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-99fd09a3-78b8-4f57-8e12-6dbe3761fb03 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:51.749059 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:51.749690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:51.755877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:51.756325 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:51.757098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:51.757535 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:51.818083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:51.827899 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:51.834140 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:51.834140 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8b8058ad-10ce-4f5b-a6e2-3514adca829a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1285 microversion: 2.20 time: 0.085695 Jan 31 04:45:51.834140 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 57/110] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:51 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:45:51.924383 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-99fd09a3-78b8-4f57-8e12-6dbe3761fb03 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:51.932132 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-99fd09a3-78b8-4f57-8e12-6dbe3761fb03 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.201960 Jan 31 04:45:51.932700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 54/111] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:51 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:52.049955 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-21ff4275-e03f-4cf6-8d94-3010e8a458a3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:52.050642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-21ff4275-e03f-4cf6-8d94-3010e8a458a3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:52.060245 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-21ff4275-e03f-4cf6-8d94-3010e8a458a3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:52.060692 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-21ff4275-e03f-4cf6-8d94-3010e8a458a3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:52.063765 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-21ff4275-e03f-4cf6-8d94-3010e8a458a3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:52.064210 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-21ff4275-e03f-4cf6-8d94-3010e8a458a3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:52.226340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-21ff4275-e03f-4cf6-8d94-3010e8a458a3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:52.234126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-21ff4275-e03f-4cf6-8d94-3010e8a458a3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.188511 Jan 31 04:45:52.234823 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 58/112] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:52 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:52.661544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-176a585a-0144-43d4-825c-778cb73fd61e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:52.666992 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-176a585a-0144-43d4-825c-778cb73fd61e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:52.673479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-176a585a-0144-43d4-825c-778cb73fd61e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:52.674060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-176a585a-0144-43d4-825c-778cb73fd61e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:52.674866 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-176a585a-0144-43d4-825c-778cb73fd61e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:52.675848 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-176a585a-0144-43d4-825c-778cb73fd61e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:52.750084 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-176a585a-0144-43d4-825c-778cb73fd61e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:52.760755 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-176a585a-0144-43d4-825c-778cb73fd61e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1288 microversion: 2.1 time: 0.111682 Jan 31 04:45:52.767186 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 55/113] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:52 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:52.849724 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:52.850483 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:52.856780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:52.857383 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:52.858942 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:52.859586 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:52.931096 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:52.941280 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:52.949353 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0fef6b91-7b2f-4900-af4e-aa8b91611103 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:52.950023 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0fef6b91-7b2f-4900-af4e-aa8b91611103 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:52.953250 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:52.969543 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a8fc0b20-1509-434a-a77d-c3b8166dbd55 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1333 microversion: 2.20 time: 0.110039 Jan 31 04:45:52.969705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0fef6b91-7b2f-4900-af4e-aa8b91611103 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:52.969705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0fef6b91-7b2f-4900-af4e-aa8b91611103 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:52.969705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0fef6b91-7b2f-4900-af4e-aa8b91611103 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:52.969705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0fef6b91-7b2f-4900-af4e-aa8b91611103 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:52.970026 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 59/114] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:52 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1333 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:53.251426 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-36cd0dc9-0f77-47c5-a9ac-1d95fbecdec7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:53.255990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0fef6b91-7b2f-4900-af4e-aa8b91611103 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:53.258585 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-36cd0dc9-0f77-47c5-a9ac-1d95fbecdec7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:53.267956 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0fef6b91-7b2f-4900-af4e-aa8b91611103 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.322462 Jan 31 04:45:53.269765 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 56/115] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:52 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:53.278669 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36cd0dc9-0f77-47c5-a9ac-1d95fbecdec7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:53.278669 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36cd0dc9-0f77-47c5-a9ac-1d95fbecdec7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:53.278669 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36cd0dc9-0f77-47c5-a9ac-1d95fbecdec7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:53.278669 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36cd0dc9-0f77-47c5-a9ac-1d95fbecdec7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:53.777444 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e7e5084d-80a5-402d-8e8f-66668ef4dec1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:53.778048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e7e5084d-80a5-402d-8e8f-66668ef4dec1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:53.785154 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e7e5084d-80a5-402d-8e8f-66668ef4dec1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:53.785992 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e7e5084d-80a5-402d-8e8f-66668ef4dec1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:53.786989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e7e5084d-80a5-402d-8e8f-66668ef4dec1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:53.787569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e7e5084d-80a5-402d-8e8f-66668ef4dec1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:53.977528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-36cd0dc9-0f77-47c5-a9ac-1d95fbecdec7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:53.978013 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-36cd0dc9-0f77-47c5-a9ac-1d95fbecdec7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.730736 Jan 31 04:45:53.987395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 60/116] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:53 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:53.987395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:53.987395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:54.009344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:54.009810 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:54.010578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:54.011042 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:54.156917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:54.164909 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:54.176709 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:54.182407 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ad8a1689-01d8-4e58-8a77-2eee8341e248 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1351 microversion: 2.20 time: 0.196857 Jan 31 04:45:54.182407 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 61/117] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:53 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:54.285458 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-384afd73-9049-4d39-b641-cf69bbccc17b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:54.286062 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-384afd73-9049-4d39-b641-cf69bbccc17b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:54.294231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-384afd73-9049-4d39-b641-cf69bbccc17b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:54.294231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-384afd73-9049-4d39-b641-cf69bbccc17b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:54.294365 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-384afd73-9049-4d39-b641-cf69bbccc17b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:54.294687 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-384afd73-9049-4d39-b641-cf69bbccc17b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:54.595374 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e7e5084d-80a5-402d-8e8f-66668ef4dec1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:54.607227 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e7e5084d-80a5-402d-8e8f-66668ef4dec1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.833446 Jan 31 04:45:54.608678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 57/118] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:53 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:45:54.616690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-384afd73-9049-4d39-b641-cf69bbccc17b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:54.626150 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-384afd73-9049-4d39-b641-cf69bbccc17b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.344234 Jan 31 04:45:54.627310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 62/119] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:54 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:55.000601 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-fcd7e8d1-6778-4168-938b-dbe13af74d8a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:55.001952 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-fcd7e8d1-6778-4168-938b-dbe13af74d8a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:55.012396 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fcd7e8d1-6778-4168-938b-dbe13af74d8a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:55.016193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fcd7e8d1-6778-4168-938b-dbe13af74d8a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:55.016193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fcd7e8d1-6778-4168-938b-dbe13af74d8a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:55.016193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fcd7e8d1-6778-4168-938b-dbe13af74d8a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:55.199524 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:55.200711 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:55.212469 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:55.212931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:55.213732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:55.220575 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:55.339111 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:55.368510 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:55.370364 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:55.373085 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3d3ccd7a-3f60-408a-9818-0ab1a8d5af41 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1339 microversion: 2.20 time: 0.176786 Jan 31 04:45:55.388386 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 63/120] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:55 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:55.579867 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-fcd7e8d1-6778-4168-938b-dbe13af74d8a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:55.595914 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-fcd7e8d1-6778-4168-938b-dbe13af74d8a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.594155 Jan 31 04:45:55.596774 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 58/121] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:54 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:55.630996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-005987c3-329b-4210-87ed-e484a6ad03b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:55.630996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-005987c3-329b-4210-87ed-e484a6ad03b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:55.645299 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c0e490bb-a2e5-4ff7-a9d2-048699e24d8a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:55.650369 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c0e490bb-a2e5-4ff7-a9d2-048699e24d8a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:55.653904 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c0e490bb-a2e5-4ff7-a9d2-048699e24d8a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:55.655571 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-005987c3-329b-4210-87ed-e484a6ad03b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:55.658349 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c0e490bb-a2e5-4ff7-a9d2-048699e24d8a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:55.660302 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-005987c3-329b-4210-87ed-e484a6ad03b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:55.662982 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c0e490bb-a2e5-4ff7-a9d2-048699e24d8a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:55.663436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c0e490bb-a2e5-4ff7-a9d2-048699e24d8a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:55.667449 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-005987c3-329b-4210-87ed-e484a6ad03b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:55.670338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-005987c3-329b-4210-87ed-e484a6ad03b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:56.120176 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-005987c3-329b-4210-87ed-e484a6ad03b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:56.129345 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-005987c3-329b-4210-87ed-e484a6ad03b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.505144 Jan 31 04:45:56.141532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 64/122] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:55 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:56.443146 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-59435a9f-3d58-456e-9dde-91a8255392e5 req-ac6a9262-ce82-4992-a368-0408b423318c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7ff86e-085c-4f11-8f98-0591b022b349", "tag": "b553d9db-0bd8-4984-9092-941cff441538"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:56.446703 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:45:56.446703 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:45:56.461689 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-59435a9f-3d58-456e-9dde-91a8255392e5 req-ac6a9262-ce82-4992-a368-0408b423318c service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:56.462422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-59435a9f-3d58-456e-9dde-91a8255392e5 req-ac6a9262-ce82-4992-a368-0408b423318c service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:56.489604 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-59435a9f-3d58-456e-9dde-91a8255392e5 req-ac6a9262-ce82-4992-a368-0408b423318c service nova] Creating event network-changed:b553d9db-0bd8-4984-9092-941cff441538 for instance 2c7ff86e-085c-4f11-8f98-0591b022b349 on hv-cinder-82660 Jan 31 04:45:56.491783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-59435a9f-3d58-456e-9dde-91a8255392e5 req-ac6a9262-ce82-4992-a368-0408b423318c service nova] Acquired lock "compute-rpcapi-router" {{(pid=123368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 31 04:45:56.493648 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f03dc197-b255-4273-9f58-6c4522b1b6f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:56.495190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f03dc197-b255-4273-9f58-6c4522b1b6f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:56.496317 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f03dc197-b255-4273-9f58-6c4522b1b6f5 None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:56.500373 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f03dc197-b255-4273-9f58-6c4522b1b6f5 None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:56.510678 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.compute.rpcapi [None req-f03dc197-b255-4273-9f58-6c4522b1b6f5 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 31 04:45:56.512391 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f03dc197-b255-4273-9f58-6c4522b1b6f5 None None] Releasing lock "compute-rpcapi-router" {{(pid=123368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 31 04:45:56.520917 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c0e490bb-a2e5-4ff7-a9d2-048699e24d8a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:56.528900 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c0e490bb-a2e5-4ff7-a9d2-048699e24d8a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.887145 Jan 31 04:45:56.533365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 59/123] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:55 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:56.541711 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:56.547766 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:56.555831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:56.560232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f03dc197-b255-4273-9f58-6c4522b1b6f5 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414555 Jan 31 04:45:56.560365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:56.560478 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 65/124] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:56.560600 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:56.561609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:56.613151 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4485cdb5-adfb-4e4f-b3e4-820a4beb661a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:56.617661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4485cdb5-adfb-4e4f-b3e4-820a4beb661a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:56.626479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4485cdb5-adfb-4e4f-b3e4-820a4beb661a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:56.627009 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4485cdb5-adfb-4e4f-b3e4-820a4beb661a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:56.628263 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4485cdb5-adfb-4e4f-b3e4-820a4beb661a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:56.628882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4485cdb5-adfb-4e4f-b3e4-820a4beb661a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:57.138641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4485cdb5-adfb-4e4f-b3e4-820a4beb661a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:57.157514 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4485cdb5-adfb-4e4f-b3e4-820a4beb661a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.542453 Jan 31 04:45:57.178879 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 66/125] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:56 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:57.221990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:57.229873 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:57.231446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:57.232578 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-baaa9732-5a13-485c-94ad-e76e21a32975 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.698006 Jan 31 04:45:57.255448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 60/126] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:56 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:57.267728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a98dff35-7aa7-4bbb-9b37-7d9902002b73 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:57.268339 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a98dff35-7aa7-4bbb-9b37-7d9902002b73 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:57.290862 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a98dff35-7aa7-4bbb-9b37-7d9902002b73 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:57.291321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a98dff35-7aa7-4bbb-9b37-7d9902002b73 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:57.293644 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a98dff35-7aa7-4bbb-9b37-7d9902002b73 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:57.296167 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a98dff35-7aa7-4bbb-9b37-7d9902002b73 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:57.678730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-6bb9d419-857f-40d8-aadd-e7e9d80ec8db req-cebc081e-e509-48a1-952d-bf7187e81517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81eea382-424b-4435-9241-e428592c98f3", "tag": "4b0786d6-d423-4590-a58e-c6f508be4b8a"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:57.680941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:45:57.680941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:45:57.711189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-6bb9d419-857f-40d8-aadd-e7e9d80ec8db req-cebc081e-e509-48a1-952d-bf7187e81517 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:57.712030 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-6bb9d419-857f-40d8-aadd-e7e9d80ec8db req-cebc081e-e509-48a1-952d-bf7187e81517 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:57.748895 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-6bb9d419-857f-40d8-aadd-e7e9d80ec8db req-cebc081e-e509-48a1-952d-bf7187e81517 service nova] Creating event network-changed:4b0786d6-d423-4590-a58e-c6f508be4b8a for instance 81eea382-424b-4435-9241-e428592c98f3 on hv-cinder-82660 Jan 31 04:45:57.762132 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-6bb9d419-857f-40d8-aadd-e7e9d80ec8db req-cebc081e-e509-48a1-952d-bf7187e81517 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.581443 Jan 31 04:45:57.763300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 67/127] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:57.792398 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1ffeac98-6f72-4fd6-ae30-d0f5665316d6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:57.794406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1ffeac98-6f72-4fd6-ae30-d0f5665316d6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:57.824748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ffeac98-6f72-4fd6-ae30-d0f5665316d6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:57.827119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ffeac98-6f72-4fd6-ae30-d0f5665316d6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:57.830881 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ffeac98-6f72-4fd6-ae30-d0f5665316d6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:57.843086 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ffeac98-6f72-4fd6-ae30-d0f5665316d6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:57.993199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a98dff35-7aa7-4bbb-9b37-7d9902002b73 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:58.002035 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a98dff35-7aa7-4bbb-9b37-7d9902002b73 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.747354 Jan 31 04:45:58.003524 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 61/128] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:57 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:58.144734 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1ffeac98-6f72-4fd6-ae30-d0f5665316d6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:58.155249 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1ffeac98-6f72-4fd6-ae30-d0f5665316d6 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.372812 Jan 31 04:45:58.156307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 68/129] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:57 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:58.173280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9ecf0223-0ff1-487c-a3ba-741f5b2ef161 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:58.174135 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9ecf0223-0ff1-487c-a3ba-741f5b2ef161 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:58.188402 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ecf0223-0ff1-487c-a3ba-741f5b2ef161 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:58.189020 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ecf0223-0ff1-487c-a3ba-741f5b2ef161 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:58.189965 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ecf0223-0ff1-487c-a3ba-741f5b2ef161 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:58.190392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ecf0223-0ff1-487c-a3ba-741f5b2ef161 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:58.262225 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:58.263116 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:58.275937 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:58.276751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:58.277980 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:58.279175 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:58.551366 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:58.562323 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:58.565563 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:58.566359 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f48c7f40-b6cc-48bc-9d78-f3ec6b03d462 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.308040 Jan 31 04:45:58.567415 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 69/130] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:58 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:45:58.593300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-1f190838-cd1d-43d2-91f7-76e109651d04 req-b9671176-9749-4306-a9c4-d9d5ef0945a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde1517d-e13d-455c-a8dd-0119bb29148b", "tag": "2eade66b-918f-4c8e-a64c-60d0ce7921a5"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:58.595753 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:45:58.595753 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:45:58.604777 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-1f190838-cd1d-43d2-91f7-76e109651d04 req-b9671176-9749-4306-a9c4-d9d5ef0945a6 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:58.605679 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-1f190838-cd1d-43d2-91f7-76e109651d04 req-b9671176-9749-4306-a9c4-d9d5ef0945a6 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:58.618841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-1f190838-cd1d-43d2-91f7-76e109651d04 req-b9671176-9749-4306-a9c4-d9d5ef0945a6 service nova] Creating event network-changed:2eade66b-918f-4c8e-a64c-60d0ce7921a5 for instance dde1517d-e13d-455c-a8dd-0119bb29148b on hv-cinder-82660 Jan 31 04:45:58.623906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-1f190838-cd1d-43d2-91f7-76e109651d04 req-b9671176-9749-4306-a9c4-d9d5ef0945a6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035928 Jan 31 04:45:58.625136 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 70/131] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:58.787906 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9ecf0223-0ff1-487c-a3ba-741f5b2ef161 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:58.798365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9ecf0223-0ff1-487c-a3ba-741f5b2ef161 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.628514 Jan 31 04:45:58.798963 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 62/132] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:58 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:59.025717 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1b18785d-2db7-43c6-b94f-f273bc986aa4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:59.027274 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1b18785d-2db7-43c6-b94f-f273bc986aa4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:59.034466 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b18785d-2db7-43c6-b94f-f273bc986aa4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.034949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b18785d-2db7-43c6-b94f-f273bc986aa4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:59.035934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b18785d-2db7-43c6-b94f-f273bc986aa4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.036522 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b18785d-2db7-43c6-b94f-f273bc986aa4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:59.172655 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6ebca596-c61f-48b3-8dfc-901df43613d2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:59.176023 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6ebca596-c61f-48b3-8dfc-901df43613d2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:59.187576 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6ebca596-c61f-48b3-8dfc-901df43613d2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.188200 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6ebca596-c61f-48b3-8dfc-901df43613d2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:59.189383 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6ebca596-c61f-48b3-8dfc-901df43613d2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.189929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6ebca596-c61f-48b3-8dfc-901df43613d2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:59.366956 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6ebca596-c61f-48b3-8dfc-901df43613d2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:59.375181 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6ebca596-c61f-48b3-8dfc-901df43613d2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.206351 Jan 31 04:45:59.375753 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 63/133] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:59 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:59.461752 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1b18785d-2db7-43c6-b94f-f273bc986aa4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:59.469461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1b18785d-2db7-43c6-b94f-f273bc986aa4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.447602 Jan 31 04:45:59.479496 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 71/134] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:59 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:45:59.584079 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:59.585739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:59.592110 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.594729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:59.594729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.594729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:59.741759 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:59.750058 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:59.751578 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:45:59.752660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-657c8260-a8f1-4e6f-887e-784a5bb9798b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.172476 Jan 31 04:45:59.753205 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 64/135] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:45:59 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:45:59.784966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-6378a50e-526f-43a9-a3d4-1e12feea978c req-80854bd0-fad9-4634-9c60-c3408b5bf75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9c56db-f2a0-485f-83e4-bc1b8b9172cf", "tag": "349870cb-d883-4ba5-862f-01f28757a4f8"}, {"name": "network-changed", "server_uuid": "c7066f95-24c8-4df3-8703-78616c09fd0e", "tag": "48d0d5c8-7822-42f9-8635-3991c50d27a3"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:45:59.786579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:45:59.786579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:45:59.794185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-6378a50e-526f-43a9-a3d4-1e12feea978c req-80854bd0-fad9-4634-9c60-c3408b5bf75f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.794617 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-6378a50e-526f-43a9-a3d4-1e12feea978c req-80854bd0-fad9-4634-9c60-c3408b5bf75f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:59.807344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-6378a50e-526f-43a9-a3d4-1e12feea978c req-80854bd0-fad9-4634-9c60-c3408b5bf75f service nova] Creating event network-changed:349870cb-d883-4ba5-862f-01f28757a4f8 for instance dd9c56db-f2a0-485f-83e4-bc1b8b9172cf on hv-cinder-82660 Jan 31 04:45:59.807780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-6378a50e-526f-43a9-a3d4-1e12feea978c req-80854bd0-fad9-4634-9c60-c3408b5bf75f service nova] Creating event network-changed:48d0d5c8-7822-42f9-8635-3991c50d27a3 for instance c7066f95-24c8-4df3-8703-78616c09fd0e on hv-cinder-82660 Jan 31 04:45:59.814010 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-6378a50e-526f-43a9-a3d4-1e12feea978c req-80854bd0-fad9-4634-9c60-c3408b5bf75f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032604 Jan 31 04:45:59.814599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 72/136] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:45:59.814714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f1224382-65bb-438d-8533-9d9252ce7a6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:45:59.815364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f1224382-65bb-438d-8533-9d9252ce7a6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:45:59.821360 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1224382-65bb-438d-8533-9d9252ce7a6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.821808 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1224382-65bb-438d-8533-9d9252ce7a6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:45:59.822576 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1224382-65bb-438d-8533-9d9252ce7a6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:45:59.823040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1224382-65bb-438d-8533-9d9252ce7a6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:00.005910 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f1224382-65bb-438d-8533-9d9252ce7a6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:00.016760 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f1224382-65bb-438d-8533-9d9252ce7a6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.205417 Jan 31 04:46:00.017915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 65/137] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:45:59 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:00.393631 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cb8b654a-1ea8-4581-bf9a-6a52fa6002d7 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:00.394407 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cb8b654a-1ea8-4581-bf9a-6a52fa6002d7 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:00.400482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb8b654a-1ea8-4581-bf9a-6a52fa6002d7 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:00.400998 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb8b654a-1ea8-4581-bf9a-6a52fa6002d7 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:00.401883 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb8b654a-1ea8-4581-bf9a-6a52fa6002d7 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:00.402384 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb8b654a-1ea8-4581-bf9a-6a52fa6002d7 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:00.486512 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-761211f3-361e-4767-9868-7622a57fca63 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:00.487966 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-761211f3-361e-4767-9868-7622a57fca63 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:00.493971 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-761211f3-361e-4767-9868-7622a57fca63 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:00.494636 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-761211f3-361e-4767-9868-7622a57fca63 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:00.495516 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-761211f3-361e-4767-9868-7622a57fca63 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:00.495945 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-761211f3-361e-4767-9868-7622a57fca63 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:00.599390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cb8b654a-1ea8-4581-bf9a-6a52fa6002d7 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:00.615067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cb8b654a-1ea8-4581-bf9a-6a52fa6002d7 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.226658 Jan 31 04:46:00.615915 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 73/138] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:00 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:00.664357 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-761211f3-361e-4767-9868-7622a57fca63 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:00.672311 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-761211f3-361e-4767-9868-7622a57fca63 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.189288 Jan 31 04:46:00.672862 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 66/139] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:00 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:00.770492 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:00.771183 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:00.776843 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:00.777280 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:00.778039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:00.778461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:01.000485 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:01.008455 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:01.010200 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:01.011355 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-83ed2d4f-d197-46e3-a799-b48ad6f137ea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.244486 Jan 31 04:46:01.011905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 74/140] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:00 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:01.033744 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b96f4484-9ccc-4d0d-b4f6-8b14ac06f512 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:01.034388 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b96f4484-9ccc-4d0d-b4f6-8b14ac06f512 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:01.040097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b96f4484-9ccc-4d0d-b4f6-8b14ac06f512 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:01.040543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b96f4484-9ccc-4d0d-b4f6-8b14ac06f512 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:01.041318 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b96f4484-9ccc-4d0d-b4f6-8b14ac06f512 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:01.041760 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b96f4484-9ccc-4d0d-b4f6-8b14ac06f512 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:01.177093 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b96f4484-9ccc-4d0d-b4f6-8b14ac06f512 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:01.184404 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b96f4484-9ccc-4d0d-b4f6-8b14ac06f512 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.154958 Jan 31 04:46:01.184959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 67/141] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:01 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:01.632162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8c1b6989-c24a-47e7-94d1-88c56d64798e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:01.632668 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8c1b6989-c24a-47e7-94d1-88c56d64798e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:01.638338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c1b6989-c24a-47e7-94d1-88c56d64798e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:01.638895 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c1b6989-c24a-47e7-94d1-88c56d64798e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:01.639674 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c1b6989-c24a-47e7-94d1-88c56d64798e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:01.640112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c1b6989-c24a-47e7-94d1-88c56d64798e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:01.689436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6bfca13f-aef0-4c7d-9ceb-24ee229c02d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:01.690071 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6bfca13f-aef0-4c7d-9ceb-24ee229c02d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:01.695853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6bfca13f-aef0-4c7d-9ceb-24ee229c02d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:01.696296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6bfca13f-aef0-4c7d-9ceb-24ee229c02d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:01.697073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6bfca13f-aef0-4c7d-9ceb-24ee229c02d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:01.697520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6bfca13f-aef0-4c7d-9ceb-24ee229c02d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:01.787749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8c1b6989-c24a-47e7-94d1-88c56d64798e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:01.795787 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8c1b6989-c24a-47e7-94d1-88c56d64798e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.166961 Jan 31 04:46:01.796358 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 75/142] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:01 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:01.846096 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6bfca13f-aef0-4c7d-9ceb-24ee229c02d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:01.853187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6bfca13f-aef0-4c7d-9ceb-24ee229c02d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.167992 Jan 31 04:46:01.853729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 68/143] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:01 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:02.030521 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:02.031236 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:02.037497 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:02.037911 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:02.038847 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:02.039445 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:02.183034 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:02.190918 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:02.192386 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:02.193487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c14dda27-7923-4c93-8404-d0c9c6625348 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.168008 Jan 31 04:46:02.194037 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 76/144] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:02 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:02.201463 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8047ecab-3e6d-49f3-9f86-2ca97ca4e4f1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:02.202060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8047ecab-3e6d-49f3-9f86-2ca97ca4e4f1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:02.211623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8047ecab-3e6d-49f3-9f86-2ca97ca4e4f1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:02.211623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8047ecab-3e6d-49f3-9f86-2ca97ca4e4f1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:02.211623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8047ecab-3e6d-49f3-9f86-2ca97ca4e4f1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:02.211963 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8047ecab-3e6d-49f3-9f86-2ca97ca4e4f1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:02.347006 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8047ecab-3e6d-49f3-9f86-2ca97ca4e4f1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:02.354147 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8047ecab-3e6d-49f3-9f86-2ca97ca4e4f1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.156646 Jan 31 04:46:02.354706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 69/145] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:02 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:02.811633 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-52a85786-5076-4684-9a08-eea78934efc9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:02.812238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-52a85786-5076-4684-9a08-eea78934efc9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:02.818112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-52a85786-5076-4684-9a08-eea78934efc9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:02.818559 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-52a85786-5076-4684-9a08-eea78934efc9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:02.819360 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-52a85786-5076-4684-9a08-eea78934efc9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:02.819796 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-52a85786-5076-4684-9a08-eea78934efc9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:02.870750 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3541efcb-2d1b-43ea-8e27-d21445045ea2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:02.871345 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3541efcb-2d1b-43ea-8e27-d21445045ea2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:02.877640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3541efcb-2d1b-43ea-8e27-d21445045ea2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:02.878081 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3541efcb-2d1b-43ea-8e27-d21445045ea2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:02.878876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3541efcb-2d1b-43ea-8e27-d21445045ea2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:02.879316 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3541efcb-2d1b-43ea-8e27-d21445045ea2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:02.951104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-52a85786-5076-4684-9a08-eea78934efc9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:02.958814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-52a85786-5076-4684-9a08-eea78934efc9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.150667 Jan 31 04:46:02.959380 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 77/146] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:02 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:03.013251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3541efcb-2d1b-43ea-8e27-d21445045ea2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:03.021012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3541efcb-2d1b-43ea-8e27-d21445045ea2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.154023 Jan 31 04:46:03.021555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 70/147] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:02 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:03.211564 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:03.212169 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:03.219076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:03.219519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:03.220470 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:03.220907 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:03.354651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:03.362274 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:03.363780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:03.364891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-521c7f8b-50b9-4548-b01f-9e8f9d9f925e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.156971 Jan 31 04:46:03.365452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 78/148] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:03 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:03.371062 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c1dc0b52-8104-494b-92c8-acff71cffb78 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:03.371750 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c1dc0b52-8104-494b-92c8-acff71cffb78 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:03.378198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c1dc0b52-8104-494b-92c8-acff71cffb78 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:03.378640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c1dc0b52-8104-494b-92c8-acff71cffb78 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:03.379452 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c1dc0b52-8104-494b-92c8-acff71cffb78 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:03.379880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c1dc0b52-8104-494b-92c8-acff71cffb78 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:03.508122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c1dc0b52-8104-494b-92c8-acff71cffb78 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:03.516306 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c1dc0b52-8104-494b-92c8-acff71cffb78 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.148742 Jan 31 04:46:03.516864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 71/149] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:03 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:03.976221 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d3184335-53db-4609-8b33-fc61f4b94faa tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:03.976910 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d3184335-53db-4609-8b33-fc61f4b94faa tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:03.983967 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d3184335-53db-4609-8b33-fc61f4b94faa tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:03.984412 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d3184335-53db-4609-8b33-fc61f4b94faa tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:03.985185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d3184335-53db-4609-8b33-fc61f4b94faa tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:03.985614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d3184335-53db-4609-8b33-fc61f4b94faa tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:04.037126 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d25102ff-1656-424e-a240-b9976e71ba50 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:04.037730 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d25102ff-1656-424e-a240-b9976e71ba50 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:04.043548 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d25102ff-1656-424e-a240-b9976e71ba50 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:04.043927 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d25102ff-1656-424e-a240-b9976e71ba50 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:04.045265 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d25102ff-1656-424e-a240-b9976e71ba50 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:04.045780 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d25102ff-1656-424e-a240-b9976e71ba50 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:04.121430 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d3184335-53db-4609-8b33-fc61f4b94faa tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:04.129521 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d3184335-53db-4609-8b33-fc61f4b94faa tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.156694 Jan 31 04:46:04.129941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 79/150] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:03 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:04.181685 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d25102ff-1656-424e-a240-b9976e71ba50 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:04.188816 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d25102ff-1656-424e-a240-b9976e71ba50 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.155241 Jan 31 04:46:04.189396 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 72/151] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:04 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:04.383298 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:04.383898 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:04.390287 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:04.390725 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:04.391529 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:04.391981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:04.523926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:04.532766 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:04.533221 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-79121d4c-ddab-460d-8a54-28f0e9f4d31c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:04.533854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-79121d4c-ddab-460d-8a54-28f0e9f4d31c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:04.534238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:04.535351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b57bf3bc-c83f-41b1-afae-83dab34ed7a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.155947 Jan 31 04:46:04.536060 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 80/152] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:04 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:04.539700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-79121d4c-ddab-460d-8a54-28f0e9f4d31c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:04.540140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-79121d4c-ddab-460d-8a54-28f0e9f4d31c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:04.540897 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-79121d4c-ddab-460d-8a54-28f0e9f4d31c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:04.541320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-79121d4c-ddab-460d-8a54-28f0e9f4d31c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:04.670637 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-79121d4c-ddab-460d-8a54-28f0e9f4d31c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:04.677711 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-79121d4c-ddab-460d-8a54-28f0e9f4d31c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.148940 Jan 31 04:46:04.678263 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 73/153] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:04 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:05.145366 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8977cee8-42bc-47c8-892f-c3fcfbcd3aaf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:05.146078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8977cee8-42bc-47c8-892f-c3fcfbcd3aaf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:05.151879 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8977cee8-42bc-47c8-892f-c3fcfbcd3aaf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:05.152317 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8977cee8-42bc-47c8-892f-c3fcfbcd3aaf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:05.153139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8977cee8-42bc-47c8-892f-c3fcfbcd3aaf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:05.153661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8977cee8-42bc-47c8-892f-c3fcfbcd3aaf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:05.204370 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b5c05540-2a41-4f59-90b3-106f50824795 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:05.204975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b5c05540-2a41-4f59-90b3-106f50824795 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:05.211615 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b5c05540-2a41-4f59-90b3-106f50824795 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:05.212065 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b5c05540-2a41-4f59-90b3-106f50824795 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:05.212848 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b5c05540-2a41-4f59-90b3-106f50824795 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:05.213282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b5c05540-2a41-4f59-90b3-106f50824795 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:05.287292 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8977cee8-42bc-47c8-892f-c3fcfbcd3aaf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:05.295305 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8977cee8-42bc-47c8-892f-c3fcfbcd3aaf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.152989 Jan 31 04:46:05.296511 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 81/154] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:05 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:05.353999 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b5c05540-2a41-4f59-90b3-106f50824795 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:05.362355 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b5c05540-2a41-4f59-90b3-106f50824795 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.161496 Jan 31 04:46:05.362955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 74/155] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:05 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:05.553018 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:05.553735 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:05.559562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:05.560004 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:05.561340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:05.561771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:05.693280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5daf56e4-72e4-459e-a471-26954dbd43a0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:05.694106 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5daf56e4-72e4-459e-a471-26954dbd43a0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:05.700622 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5daf56e4-72e4-459e-a471-26954dbd43a0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:05.701312 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5daf56e4-72e4-459e-a471-26954dbd43a0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:05.702613 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5daf56e4-72e4-459e-a471-26954dbd43a0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:05.703597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5daf56e4-72e4-459e-a471-26954dbd43a0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:05.705060 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:05.725062 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:05.730432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:05.731806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f9f2f14a-e711-489c-8ca4-9aea71269aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.182779 Jan 31 04:46:05.735422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 82/156] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:05 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:05.854848 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5daf56e4-72e4-459e-a471-26954dbd43a0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:05.863258 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5daf56e4-72e4-459e-a471-26954dbd43a0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.173673 Jan 31 04:46:05.863943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 75/157] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:05 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:06.312145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0161d81c-c261-4fd8-a0d7-7af4b50089b5 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:06.312744 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0161d81c-c261-4fd8-a0d7-7af4b50089b5 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:06.318589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0161d81c-c261-4fd8-a0d7-7af4b50089b5 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:06.319000 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0161d81c-c261-4fd8-a0d7-7af4b50089b5 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:06.319764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0161d81c-c261-4fd8-a0d7-7af4b50089b5 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:06.320192 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0161d81c-c261-4fd8-a0d7-7af4b50089b5 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:06.379470 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-09dbf7fe-ee33-45b0-8007-eb8e7f500020 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:06.380325 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-09dbf7fe-ee33-45b0-8007-eb8e7f500020 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:06.394423 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-09dbf7fe-ee33-45b0-8007-eb8e7f500020 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:06.394899 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-09dbf7fe-ee33-45b0-8007-eb8e7f500020 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:06.395673 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-09dbf7fe-ee33-45b0-8007-eb8e7f500020 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:06.396097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-09dbf7fe-ee33-45b0-8007-eb8e7f500020 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:06.490373 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0161d81c-c261-4fd8-a0d7-7af4b50089b5 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:06.498600 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0161d81c-c261-4fd8-a0d7-7af4b50089b5 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.189680 Jan 31 04:46:06.499280 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 83/158] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:06 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:06.542531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-09dbf7fe-ee33-45b0-8007-eb8e7f500020 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:06.552554 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-09dbf7fe-ee33-45b0-8007-eb8e7f500020 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.176573 Jan 31 04:46:06.553102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 76/159] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:06 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:06.752941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:06.753533 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:06.759790 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:06.760231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:06.761014 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:06.761438 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:06.880172 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d2891d5f-24fb-4eb9-8d91-993ed2fb7168 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:06.880776 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d2891d5f-24fb-4eb9-8d91-993ed2fb7168 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:06.886392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d2891d5f-24fb-4eb9-8d91-993ed2fb7168 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:06.886954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d2891d5f-24fb-4eb9-8d91-993ed2fb7168 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:06.887623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d2891d5f-24fb-4eb9-8d91-993ed2fb7168 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:06.888049 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d2891d5f-24fb-4eb9-8d91-993ed2fb7168 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:06.888465 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:06.896429 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:06.897962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:06.899086 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d82aa983-fee6-4c07-98d9-58ba7ff26e0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.149838 Jan 31 04:46:06.899642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 84/160] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:06 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:07.023016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d2891d5f-24fb-4eb9-8d91-993ed2fb7168 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:07.030066 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d2891d5f-24fb-4eb9-8d91-993ed2fb7168 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.153739 Jan 31 04:46:07.030605 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 77/161] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:06 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:07.515503 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-458f0a8b-3ccb-4fe7-8b2b-6b607f719e52 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:07.516104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-458f0a8b-3ccb-4fe7-8b2b-6b607f719e52 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:07.521841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-458f0a8b-3ccb-4fe7-8b2b-6b607f719e52 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:07.522278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-458f0a8b-3ccb-4fe7-8b2b-6b607f719e52 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:07.523071 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-458f0a8b-3ccb-4fe7-8b2b-6b607f719e52 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:07.523490 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-458f0a8b-3ccb-4fe7-8b2b-6b607f719e52 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:07.569171 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4831847c-170a-4f75-a400-f548d104d02b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:07.570387 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4831847c-170a-4f75-a400-f548d104d02b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:07.576562 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4831847c-170a-4f75-a400-f548d104d02b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:07.577029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4831847c-170a-4f75-a400-f548d104d02b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:07.577963 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4831847c-170a-4f75-a400-f548d104d02b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:07.578396 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4831847c-170a-4f75-a400-f548d104d02b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:07.656892 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-458f0a8b-3ccb-4fe7-8b2b-6b607f719e52 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:07.664264 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-458f0a8b-3ccb-4fe7-8b2b-6b607f719e52 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.152434 Jan 31 04:46:07.664830 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 85/162] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:07 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:07.705808 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4831847c-170a-4f75-a400-f548d104d02b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:07.712929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4831847c-170a-4f75-a400-f548d104d02b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.147502 Jan 31 04:46:07.713479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 78/163] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:07 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:07.915618 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:07.916215 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:07.922901 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:07.923344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:07.924103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:07.924538 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:08.047584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1c676d70-5d1c-410a-999a-4d48b3a75a32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:08.048181 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1c676d70-5d1c-410a-999a-4d48b3a75a32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:08.053773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1c676d70-5d1c-410a-999a-4d48b3a75a32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:08.054209 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1c676d70-5d1c-410a-999a-4d48b3a75a32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:08.054776 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:08.055005 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1c676d70-5d1c-410a-999a-4d48b3a75a32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:08.055430 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1c676d70-5d1c-410a-999a-4d48b3a75a32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:08.062536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:08.064065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:08.065156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-51f61db9-3c57-4066-8e44-67c128e6fa2f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.153274 Jan 31 04:46:08.065702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 86/164] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:07 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:08.188969 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1c676d70-5d1c-410a-999a-4d48b3a75a32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:08.196221 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1c676d70-5d1c-410a-999a-4d48b3a75a32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.153030 Jan 31 04:46:08.196854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 79/165] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:08 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:08.680928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b6e38532-b5cd-49c0-9c8c-d222b9e4630e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:08.681522 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b6e38532-b5cd-49c0-9c8c-d222b9e4630e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:08.687880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6e38532-b5cd-49c0-9c8c-d222b9e4630e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:08.688318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6e38532-b5cd-49c0-9c8c-d222b9e4630e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:08.689069 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6e38532-b5cd-49c0-9c8c-d222b9e4630e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:08.689493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6e38532-b5cd-49c0-9c8c-d222b9e4630e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:08.729843 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c18753b5-0743-4ecc-9022-c5f0bf1ebce7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:08.730410 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c18753b5-0743-4ecc-9022-c5f0bf1ebce7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:08.736318 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c18753b5-0743-4ecc-9022-c5f0bf1ebce7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:08.736752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c18753b5-0743-4ecc-9022-c5f0bf1ebce7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:08.737564 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c18753b5-0743-4ecc-9022-c5f0bf1ebce7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:08.737990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c18753b5-0743-4ecc-9022-c5f0bf1ebce7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:08.819321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b6e38532-b5cd-49c0-9c8c-d222b9e4630e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:08.827678 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b6e38532-b5cd-49c0-9c8c-d222b9e4630e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.150315 Jan 31 04:46:08.828270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 87/166] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:08 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:08.868048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c18753b5-0743-4ecc-9022-c5f0bf1ebce7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:08.875580 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c18753b5-0743-4ecc-9022-c5f0bf1ebce7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.149421 Jan 31 04:46:08.876131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 80/167] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:08 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:09.082206 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:09.082836 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:09.088741 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:09.089184 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:09.089950 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:09.090379 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:09.212276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-de09ac25-57db-4f22-b24f-fb9cea98ffee tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:09.212972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-de09ac25-57db-4f22-b24f-fb9cea98ffee tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:09.218708 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de09ac25-57db-4f22-b24f-fb9cea98ffee tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:09.219175 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de09ac25-57db-4f22-b24f-fb9cea98ffee tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:09.219996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de09ac25-57db-4f22-b24f-fb9cea98ffee tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:09.220419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de09ac25-57db-4f22-b24f-fb9cea98ffee tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:09.224811 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:09.233231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:09.234711 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:09.235983 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-96c6ab89-1044-40fb-a1c0-4d471c53340e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.157455 Jan 31 04:46:09.236807 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 88/168] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:09 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:09.373409 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-de09ac25-57db-4f22-b24f-fb9cea98ffee tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:09.381533 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-de09ac25-57db-4f22-b24f-fb9cea98ffee tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.172820 Jan 31 04:46:09.382089 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 81/169] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:09 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:09.844432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-578509cb-4191-40b4-bab2-8b0ab2f2841b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:09.845046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-578509cb-4191-40b4-bab2-8b0ab2f2841b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:09.850817 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-578509cb-4191-40b4-bab2-8b0ab2f2841b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:09.851279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-578509cb-4191-40b4-bab2-8b0ab2f2841b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:09.852046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-578509cb-4191-40b4-bab2-8b0ab2f2841b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:09.852479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-578509cb-4191-40b4-bab2-8b0ab2f2841b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:09.892217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f4fbe3d7-c3bb-4dce-a9c6-203219f4f4c1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:09.892819 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f4fbe3d7-c3bb-4dce-a9c6-203219f4f4c1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:09.898600 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f4fbe3d7-c3bb-4dce-a9c6-203219f4f4c1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:09.899070 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f4fbe3d7-c3bb-4dce-a9c6-203219f4f4c1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:09.899841 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f4fbe3d7-c3bb-4dce-a9c6-203219f4f4c1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:09.900274 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f4fbe3d7-c3bb-4dce-a9c6-203219f4f4c1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:09.983486 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-578509cb-4191-40b4-bab2-8b0ab2f2841b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:09.990880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-578509cb-4191-40b4-bab2-8b0ab2f2841b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.150326 Jan 31 04:46:09.991445 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 89/170] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:09 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:10.034041 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f4fbe3d7-c3bb-4dce-a9c6-203219f4f4c1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:10.041130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f4fbe3d7-c3bb-4dce-a9c6-203219f4f4c1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.152657 Jan 31 04:46:10.041681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 82/171] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:09 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:10.253385 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:10.253993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:10.260338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:10.260799 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:10.261578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:10.262011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:10.399603 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6f172bbc-27c5-4d53-8713-b0239a1f4824 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:10.400238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6f172bbc-27c5-4d53-8713-b0239a1f4824 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:10.400661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:10.406949 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6f172bbc-27c5-4d53-8713-b0239a1f4824 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:10.407394 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6f172bbc-27c5-4d53-8713-b0239a1f4824 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:10.408169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6f172bbc-27c5-4d53-8713-b0239a1f4824 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:10.408598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6f172bbc-27c5-4d53-8713-b0239a1f4824 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:10.409238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:10.410892 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:10.412086 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2860714b-d13d-41ac-8755-7d1d15885539 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.162347 Jan 31 04:46:10.413721 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 90/172] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:10 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:10.544083 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6f172bbc-27c5-4d53-8713-b0239a1f4824 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:10.551801 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6f172bbc-27c5-4d53-8713-b0239a1f4824 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.156720 Jan 31 04:46:10.552507 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 83/173] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:10 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:11.008014 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d05dee51-2d13-4cbf-a984-1059e4de489c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:11.008616 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d05dee51-2d13-4cbf-a984-1059e4de489c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:11.015516 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d05dee51-2d13-4cbf-a984-1059e4de489c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:11.015961 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d05dee51-2d13-4cbf-a984-1059e4de489c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:11.016726 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d05dee51-2d13-4cbf-a984-1059e4de489c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:11.017156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d05dee51-2d13-4cbf-a984-1059e4de489c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:11.057206 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-111747fe-d511-41ac-9e13-44fba1273e5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:11.057818 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-111747fe-d511-41ac-9e13-44fba1273e5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:11.065261 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-111747fe-d511-41ac-9e13-44fba1273e5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:11.065710 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-111747fe-d511-41ac-9e13-44fba1273e5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:11.066495 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-111747fe-d511-41ac-9e13-44fba1273e5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:11.067354 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-111747fe-d511-41ac-9e13-44fba1273e5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:11.230371 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d05dee51-2d13-4cbf-a984-1059e4de489c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:11.240945 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d05dee51-2d13-4cbf-a984-1059e4de489c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.236147 Jan 31 04:46:11.252042 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 91/174] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:11 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:11.278236 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-111747fe-d511-41ac-9e13-44fba1273e5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:11.288523 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-111747fe-d511-41ac-9e13-44fba1273e5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.234781 Jan 31 04:46:11.290412 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 84/175] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:11 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:11.436890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:11.436890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:11.436890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:11.436890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:11.437652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:11.437824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:11.567918 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4fdd08f9-ab95-42ff-8542-d60f1bcd478b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:11.568520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4fdd08f9-ab95-42ff-8542-d60f1bcd478b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:11.572471 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:11.574856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4fdd08f9-ab95-42ff-8542-d60f1bcd478b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:11.575350 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4fdd08f9-ab95-42ff-8542-d60f1bcd478b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:11.576682 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4fdd08f9-ab95-42ff-8542-d60f1bcd478b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:11.577364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4fdd08f9-ab95-42ff-8542-d60f1bcd478b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:11.581306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:11.582706 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:11.583847 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6f626fb4-505e-452f-a06d-759df5fae0de tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.158437 Jan 31 04:46:11.584395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 92/176] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:11 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:11.718119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4fdd08f9-ab95-42ff-8542-d60f1bcd478b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:11.725293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4fdd08f9-ab95-42ff-8542-d60f1bcd478b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.160874 Jan 31 04:46:11.725850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 85/177] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:11 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:12.258472 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4d66b683-eaf7-4ecb-a5c1-52f76f26aa82 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:12.259111 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4d66b683-eaf7-4ecb-a5c1-52f76f26aa82 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:12.265781 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4d66b683-eaf7-4ecb-a5c1-52f76f26aa82 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.266420 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4d66b683-eaf7-4ecb-a5c1-52f76f26aa82 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.267412 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4d66b683-eaf7-4ecb-a5c1-52f76f26aa82 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.267851 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4d66b683-eaf7-4ecb-a5c1-52f76f26aa82 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.306579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2a4de449-4341-47b2-a084-57ea2ab6d4b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:12.307674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2a4de449-4341-47b2-a084-57ea2ab6d4b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:12.319291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2a4de449-4341-47b2-a084-57ea2ab6d4b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.319761 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2a4de449-4341-47b2-a084-57ea2ab6d4b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.320565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2a4de449-4341-47b2-a084-57ea2ab6d4b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.320994 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2a4de449-4341-47b2-a084-57ea2ab6d4b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.422541 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4d66b683-eaf7-4ecb-a5c1-52f76f26aa82 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:12.431623 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4d66b683-eaf7-4ecb-a5c1-52f76f26aa82 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.177138 Jan 31 04:46:12.434865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 93/178] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:12 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:12.497976 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2a4de449-4341-47b2-a084-57ea2ab6d4b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:12.506856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2a4de449-4341-47b2-a084-57ea2ab6d4b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.204055 Jan 31 04:46:12.507427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 86/179] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:12 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:12.601691 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:12.602548 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:12.608365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.608866 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.609631 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.610053 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.636054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-3dc5fc42-02f5-43eb-a3e5-5323101c1d7c req-ce80e5e0-5d46-475c-a904-303515475780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7ff86e-085c-4f11-8f98-0591b022b349", "name": "network-vif-plugged", "status": "completed", "tag": "b553d9db-0bd8-4984-9092-941cff441538"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:12.637662 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:46:12.637662 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:46:12.645430 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-3dc5fc42-02f5-43eb-a3e5-5323101c1d7c req-ce80e5e0-5d46-475c-a904-303515475780 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.645868 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-3dc5fc42-02f5-43eb-a3e5-5323101c1d7c req-ce80e5e0-5d46-475c-a904-303515475780 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.656922 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-3dc5fc42-02f5-43eb-a3e5-5323101c1d7c req-ce80e5e0-5d46-475c-a904-303515475780 service nova] Creating event network-vif-plugged:b553d9db-0bd8-4984-9092-941cff441538 for instance 2c7ff86e-085c-4f11-8f98-0591b022b349 on hv-cinder-82660 Jan 31 04:46:12.661875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-3dc5fc42-02f5-43eb-a3e5-5323101c1d7c req-ce80e5e0-5d46-475c-a904-303515475780 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143729 Jan 31 04:46:12.662472 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 94/180] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:46:12.742151 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-df3bbfc8-2c69-4ea7-872d-363408317659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:12.743094 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-df3bbfc8-2c69-4ea7-872d-363408317659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:12.748652 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:12.749936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-df3bbfc8-2c69-4ea7-872d-363408317659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.750565 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-df3bbfc8-2c69-4ea7-872d-363408317659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.751696 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-df3bbfc8-2c69-4ea7-872d-363408317659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:12.752144 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-df3bbfc8-2c69-4ea7-872d-363408317659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:12.757913 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:12.759531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:12.760817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d01cf3c3-659e-491a-8050-b49a883fffd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.163217 Jan 31 04:46:12.762925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 87/181] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:12 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:12.926221 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-df3bbfc8-2c69-4ea7-872d-363408317659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:12.933651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-df3bbfc8-2c69-4ea7-872d-363408317659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.195939 Jan 31 04:46:12.934207 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 95/182] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:12 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:13.449017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-212b6c38-dbcd-470e-b545-01503f9f057a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:13.449623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-212b6c38-dbcd-470e-b545-01503f9f057a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:13.458190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-212b6c38-dbcd-470e-b545-01503f9f057a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:13.458638 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-212b6c38-dbcd-470e-b545-01503f9f057a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:13.459447 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-212b6c38-dbcd-470e-b545-01503f9f057a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:13.459874 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-212b6c38-dbcd-470e-b545-01503f9f057a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:13.523773 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7ad4a08c-e70c-4b78-acd9-e305ed3f9ef0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:13.524998 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7ad4a08c-e70c-4b78-acd9-e305ed3f9ef0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:13.531614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7ad4a08c-e70c-4b78-acd9-e305ed3f9ef0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:13.532252 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7ad4a08c-e70c-4b78-acd9-e305ed3f9ef0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:13.533180 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7ad4a08c-e70c-4b78-acd9-e305ed3f9ef0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:13.533599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7ad4a08c-e70c-4b78-acd9-e305ed3f9ef0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:13.631073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-212b6c38-dbcd-470e-b545-01503f9f057a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:13.638817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-212b6c38-dbcd-470e-b545-01503f9f057a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.193452 Jan 31 04:46:13.639369 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 88/183] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:13 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:13.678257 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7ad4a08c-e70c-4b78-acd9-e305ed3f9ef0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:13.685389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7ad4a08c-e70c-4b78-acd9-e305ed3f9ef0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.165169 Jan 31 04:46:13.686346 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 96/184] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:13 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:13.778007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:13.778613 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:13.785290 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:13.785739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:13.786509 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:13.786994 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:13.921028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:13.928678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:13.930144 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:13.931251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0427f882-1808-4541-a3e7-dcfa4e73fabc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.156923 Jan 31 04:46:13.931792 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 89/185] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:13 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:13.951001 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c7521822-3739-4dd0-bd41-c28c6787edae tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:13.951875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c7521822-3739-4dd0-bd41-c28c6787edae tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:13.974431 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c7521822-3739-4dd0-bd41-c28c6787edae tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:13.974904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c7521822-3739-4dd0-bd41-c28c6787edae tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:13.975673 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c7521822-3739-4dd0-bd41-c28c6787edae tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:13.976101 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c7521822-3739-4dd0-bd41-c28c6787edae tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:14.169238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c7521822-3739-4dd0-bd41-c28c6787edae tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:14.177321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c7521822-3739-4dd0-bd41-c28c6787edae tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.230266 Jan 31 04:46:14.177898 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 97/186] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:13 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:14.656354 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5b711f64-6fd8-4c1d-a5c9-e1a30df9498b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:14.656863 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5b711f64-6fd8-4c1d-a5c9-e1a30df9498b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:14.662681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5b711f64-6fd8-4c1d-a5c9-e1a30df9498b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:14.663174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5b711f64-6fd8-4c1d-a5c9-e1a30df9498b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:14.663969 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5b711f64-6fd8-4c1d-a5c9-e1a30df9498b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:14.664427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5b711f64-6fd8-4c1d-a5c9-e1a30df9498b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:14.703139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9c94796d-b21c-489e-8728-187c05a40188 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:14.703836 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9c94796d-b21c-489e-8728-187c05a40188 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:14.712413 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9c94796d-b21c-489e-8728-187c05a40188 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:14.712413 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9c94796d-b21c-489e-8728-187c05a40188 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:14.712413 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9c94796d-b21c-489e-8728-187c05a40188 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:14.712413 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9c94796d-b21c-489e-8728-187c05a40188 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:14.808179 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5b711f64-6fd8-4c1d-a5c9-e1a30df9498b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:14.816039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5b711f64-6fd8-4c1d-a5c9-e1a30df9498b tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.163533 Jan 31 04:46:14.816600 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 90/187] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:14 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:14.858144 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9c94796d-b21c-489e-8728-187c05a40188 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:14.866233 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9c94796d-b21c-489e-8728-187c05a40188 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.167350 Jan 31 04:46:14.866853 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 98/188] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:14 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:14.949024 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:14.949907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:14.956099 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:14.956550 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:14.957318 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:14.957751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.108113 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:15.119112 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:15.120845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:15.121956 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f07c7747-5a3f-4c7f-95b5-403a1579c11e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.176646 Jan 31 04:46:15.132241 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 91/189] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:14 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:15.201082 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-834b82df-2ce7-4dc7-8fe8-fc6e73aae709 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:15.201680 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-834b82df-2ce7-4dc7-8fe8-fc6e73aae709 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:15.207928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-834b82df-2ce7-4dc7-8fe8-fc6e73aae709 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.208364 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-834b82df-2ce7-4dc7-8fe8-fc6e73aae709 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.209126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-834b82df-2ce7-4dc7-8fe8-fc6e73aae709 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.209545 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-834b82df-2ce7-4dc7-8fe8-fc6e73aae709 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.353759 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-834b82df-2ce7-4dc7-8fe8-fc6e73aae709 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:15.361916 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-834b82df-2ce7-4dc7-8fe8-fc6e73aae709 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.164384 Jan 31 04:46:15.362479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 99/190] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:15 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:15.365339 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-c17e1e81-773f-4957-9022-3c0765fb76de req-4b8544ed-e4c5-4a6b-a7b6-a1bc626857b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7066f95-24c8-4df3-8703-78616c09fd0e", "name": "network-vif-plugged", "status": "completed", "tag": "48d0d5c8-7822-42f9-8635-3991c50d27a3"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:15.367773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:46:15.367773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:46:15.378812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-c17e1e81-773f-4957-9022-3c0765fb76de req-4b8544ed-e4c5-4a6b-a7b6-a1bc626857b2 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.379249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-c17e1e81-773f-4957-9022-3c0765fb76de req-4b8544ed-e4c5-4a6b-a7b6-a1bc626857b2 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.398820 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-c17e1e81-773f-4957-9022-3c0765fb76de req-4b8544ed-e4c5-4a6b-a7b6-a1bc626857b2 service nova] Creating event network-vif-plugged:48d0d5c8-7822-42f9-8635-3991c50d27a3 for instance c7066f95-24c8-4df3-8703-78616c09fd0e on hv-cinder-82660 Jan 31 04:46:15.399321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-c17e1e81-773f-4957-9022-3c0765fb76de req-4b8544ed-e4c5-4a6b-a7b6-a1bc626857b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 31 04:46:15.400401 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c6ace4-7675-44fb-a4d6-03bb44fd21f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.400852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c6ace4-7675-44fb-a4d6-03bb44fd21f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.401603 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c6ace4-7675-44fb-a4d6-03bb44fd21f3 None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.405943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c6ace4-7675-44fb-a4d6-03bb44fd21f3 None None] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.410251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.compute.rpcapi [None req-65c6ace4-7675-44fb-a4d6-03bb44fd21f3 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 31 04:46:15.411128 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c6ace4-7675-44fb-a4d6-03bb44fd21f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=123367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 31 04:46:15.426066 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-65c6ace4-7675-44fb-a4d6-03bb44fd21f3 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064089 Jan 31 04:46:15.426759 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 92/191] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:46:15.832284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a6eecd82-1b89-4412-9988-119c3f5c4b84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:15.832884 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a6eecd82-1b89-4412-9988-119c3f5c4b84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:15.838634 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a6eecd82-1b89-4412-9988-119c3f5c4b84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.839116 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a6eecd82-1b89-4412-9988-119c3f5c4b84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.839882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a6eecd82-1b89-4412-9988-119c3f5c4b84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.840369 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a6eecd82-1b89-4412-9988-119c3f5c4b84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.883685 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-10cfc2ea-2c91-4727-989d-c6946b7916f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:15.884485 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-10cfc2ea-2c91-4727-989d-c6946b7916f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:15.891620 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-10cfc2ea-2c91-4727-989d-c6946b7916f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.892067 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-10cfc2ea-2c91-4727-989d-c6946b7916f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.892840 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-10cfc2ea-2c91-4727-989d-c6946b7916f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:15.893272 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-10cfc2ea-2c91-4727-989d-c6946b7916f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:15.980563 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a6eecd82-1b89-4412-9988-119c3f5c4b84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:15.988573 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a6eecd82-1b89-4412-9988-119c3f5c4b84 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.159863 Jan 31 04:46:15.989150 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 100/192] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:15 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:16.033188 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-10cfc2ea-2c91-4727-989d-c6946b7916f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:16.040561 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-10cfc2ea-2c91-4727-989d-c6946b7916f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.161109 Jan 31 04:46:16.041118 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 93/193] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:15 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:16.138599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:16.139220 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:16.146145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:16.146584 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:16.147402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:16.148352 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:16.305693 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:16.313882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:16.315606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:16.316694 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b5c37b6e-8e48-49e2-a802-8ad063d28728 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.181681 Jan 31 04:46:16.317240 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 101/194] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:16 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:16.378501 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c63862fc-2546-4bde-81dc-2e961a99a8bd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:16.379129 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c63862fc-2546-4bde-81dc-2e961a99a8bd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:16.385189 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c63862fc-2546-4bde-81dc-2e961a99a8bd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:16.385625 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c63862fc-2546-4bde-81dc-2e961a99a8bd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:16.386372 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c63862fc-2546-4bde-81dc-2e961a99a8bd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:16.386815 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c63862fc-2546-4bde-81dc-2e961a99a8bd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:16.522407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c63862fc-2546-4bde-81dc-2e961a99a8bd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:16.529695 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c63862fc-2546-4bde-81dc-2e961a99a8bd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.154753 Jan 31 04:46:16.530271 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 94/195] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:16 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:17.005144 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-532d91d9-d97c-4964-a110-6c05536533bf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:17.006172 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-532d91d9-d97c-4964-a110-6c05536533bf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:17.013184 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-532d91d9-d97c-4964-a110-6c05536533bf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.013824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-532d91d9-d97c-4964-a110-6c05536533bf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.014904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-532d91d9-d97c-4964-a110-6c05536533bf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.015555 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-532d91d9-d97c-4964-a110-6c05536533bf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.056949 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cfb94e60-681c-46ba-8658-d82d9f64b960 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:17.057540 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cfb94e60-681c-46ba-8658-d82d9f64b960 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:17.070252 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cfb94e60-681c-46ba-8658-d82d9f64b960 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.070695 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cfb94e60-681c-46ba-8658-d82d9f64b960 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.071527 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cfb94e60-681c-46ba-8658-d82d9f64b960 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.071954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cfb94e60-681c-46ba-8658-d82d9f64b960 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.316754 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cfb94e60-681c-46ba-8658-d82d9f64b960 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:17.324187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cfb94e60-681c-46ba-8658-d82d9f64b960 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.270765 Jan 31 04:46:17.324796 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 95/196] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:17 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:17.344203 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:17.344785 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:17.351299 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.351737 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.352507 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.352933 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.401393 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-532d91d9-d97c-4964-a110-6c05536533bf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:17.410950 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-532d91d9-d97c-4964-a110-6c05536533bf tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.409748 Jan 31 04:46:17.411596 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 102/197] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:16 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:17.440918 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-cf2e0fb6-fb5d-45fa-bd25-11efa85503db req-81923562-fe28-4e97-887b-4aeed285025a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9c56db-f2a0-485f-83e4-bc1b8b9172cf", "name": "network-vif-plugged", "status": "completed", "tag": "349870cb-d883-4ba5-862f-01f28757a4f8"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:17.442549 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:46:17.442549 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:46:17.449610 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-cf2e0fb6-fb5d-45fa-bd25-11efa85503db req-81923562-fe28-4e97-887b-4aeed285025a service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.450048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-cf2e0fb6-fb5d-45fa-bd25-11efa85503db req-81923562-fe28-4e97-887b-4aeed285025a service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.461502 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-cf2e0fb6-fb5d-45fa-bd25-11efa85503db req-81923562-fe28-4e97-887b-4aeed285025a service nova] Creating event network-vif-plugged:349870cb-d883-4ba5-862f-01f28757a4f8 for instance dd9c56db-f2a0-485f-83e4-bc1b8b9172cf on hv-cinder-82660 Jan 31 04:46:17.466419 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-cf2e0fb6-fb5d-45fa-bd25-11efa85503db req-81923562-fe28-4e97-887b-4aeed285025a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029138 Jan 31 04:46:17.467045 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 103/198] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:46:17.543794 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:17.547288 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4925666d-c35a-4455-b272-680bba8141e2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:17.547993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4925666d-c35a-4455-b272-680bba8141e2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:17.551878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:17.553393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:17.554344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4925666d-c35a-4455-b272-680bba8141e2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.554730 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-875731c0-cb00-4004-a194-ca0fa76a91d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.214826 Jan 31 04:46:17.554854 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4925666d-c35a-4455-b272-680bba8141e2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.555302 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 96/199] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:17 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:17.555575 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4925666d-c35a-4455-b272-680bba8141e2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:17.556008 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4925666d-c35a-4455-b272-680bba8141e2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:17.688148 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4925666d-c35a-4455-b272-680bba8141e2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:17.695422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4925666d-c35a-4455-b272-680bba8141e2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.152932 Jan 31 04:46:17.695982 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 104/200] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:17 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:18.344404 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c74a10ab-515d-498f-841b-7127690303e3 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:18.345614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c74a10ab-515d-498f-841b-7127690303e3 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:18.351460 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c74a10ab-515d-498f-841b-7127690303e3 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:18.351907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c74a10ab-515d-498f-841b-7127690303e3 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:18.352769 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c74a10ab-515d-498f-841b-7127690303e3 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:18.353204 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c74a10ab-515d-498f-841b-7127690303e3 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:18.427797 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9eb64126-b9d1-410f-92b8-aec722b3ab3c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:18.429057 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9eb64126-b9d1-410f-92b8-aec722b3ab3c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:18.445065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9eb64126-b9d1-410f-92b8-aec722b3ab3c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:18.445506 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9eb64126-b9d1-410f-92b8-aec722b3ab3c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:18.446428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9eb64126-b9d1-410f-92b8-aec722b3ab3c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:18.446733 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9eb64126-b9d1-410f-92b8-aec722b3ab3c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:18.504083 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c74a10ab-515d-498f-841b-7127690303e3 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:18.513294 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c74a10ab-515d-498f-841b-7127690303e3 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.173301 Jan 31 04:46:18.514596 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 97/201] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:18 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:18.573207 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:18.573926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:18.584424 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:18.584852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:18.585622 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:18.586051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:18.598139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9eb64126-b9d1-410f-92b8-aec722b3ab3c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:18.607506 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9eb64126-b9d1-410f-92b8-aec722b3ab3c tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.183241 Jan 31 04:46:18.608085 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 105/202] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:18 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:18.711654 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2746a1eb-65c9-4ac2-a897-813eb3fd3e70 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:18.712281 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2746a1eb-65c9-4ac2-a897-813eb3fd3e70 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:18.718767 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2746a1eb-65c9-4ac2-a897-813eb3fd3e70 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:18.719303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2746a1eb-65c9-4ac2-a897-813eb3fd3e70 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:18.720269 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2746a1eb-65c9-4ac2-a897-813eb3fd3e70 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:18.720606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2746a1eb-65c9-4ac2-a897-813eb3fd3e70 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:18.732622 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:18.740342 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:18.741834 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:18.743022 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ae30fad6-8996-479a-a586-dc424133dad9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.173592 Jan 31 04:46:18.743591 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 98/203] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:18 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:18.896899 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2746a1eb-65c9-4ac2-a897-813eb3fd3e70 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:18.904602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2746a1eb-65c9-4ac2-a897-813eb3fd3e70 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.196404 Jan 31 04:46:18.905201 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 106/204] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:18 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:19.480544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-ef60586f-c018-4030-9554-8eeb023d9a84 req-48deb717-b3aa-4efc-b315-c7ffd0fa4cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81eea382-424b-4435-9241-e428592c98f3", "name": "network-vif-plugged", "status": "completed", "tag": "4b0786d6-d423-4590-a58e-c6f508be4b8a"}, {"server_uuid": "dde1517d-e13d-455c-a8dd-0119bb29148b", "name": "network-vif-plugged", "status": "completed", "tag": "2eade66b-918f-4c8e-a64c-60d0ce7921a5"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:19.482339 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:46:19.482339 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:46:19.490430 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-ef60586f-c018-4030-9554-8eeb023d9a84 req-48deb717-b3aa-4efc-b315-c7ffd0fa4cb4 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.490893 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-ef60586f-c018-4030-9554-8eeb023d9a84 req-48deb717-b3aa-4efc-b315-c7ffd0fa4cb4 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:19.503446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-ef60586f-c018-4030-9554-8eeb023d9a84 req-48deb717-b3aa-4efc-b315-c7ffd0fa4cb4 service nova] Creating event network-vif-plugged:4b0786d6-d423-4590-a58e-c6f508be4b8a for instance 81eea382-424b-4435-9241-e428592c98f3 on hv-cinder-82660 Jan 31 04:46:19.503945 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-ef60586f-c018-4030-9554-8eeb023d9a84 req-48deb717-b3aa-4efc-b315-c7ffd0fa4cb4 service nova] Creating event network-vif-plugged:2eade66b-918f-4c8e-a64c-60d0ce7921a5 for instance dde1517d-e13d-455c-a8dd-0119bb29148b on hv-cinder-82660 Jan 31 04:46:19.510440 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-ef60586f-c018-4030-9554-8eeb023d9a84 req-48deb717-b3aa-4efc-b315-c7ffd0fa4cb4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033444 Jan 31 04:46:19.511287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 99/205] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:46:19.529818 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7e8c0dcc-499a-4356-aa4d-123cb86d8cde tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:19.531073 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7e8c0dcc-499a-4356-aa4d-123cb86d8cde tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:19.536975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7e8c0dcc-499a-4356-aa4d-123cb86d8cde tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.538267 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7e8c0dcc-499a-4356-aa4d-123cb86d8cde tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:19.538267 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7e8c0dcc-499a-4356-aa4d-123cb86d8cde tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.538637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7e8c0dcc-499a-4356-aa4d-123cb86d8cde tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:19.629258 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4c79b54d-3f20-4f3e-8acb-4228f8fc0fd0 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:19.630977 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4c79b54d-3f20-4f3e-8acb-4228f8fc0fd0 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:19.650010 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4c79b54d-3f20-4f3e-8acb-4228f8fc0fd0 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.650635 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4c79b54d-3f20-4f3e-8acb-4228f8fc0fd0 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:19.651623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4c79b54d-3f20-4f3e-8acb-4228f8fc0fd0 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.652118 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4c79b54d-3f20-4f3e-8acb-4228f8fc0fd0 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:19.774509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7e8c0dcc-499a-4356-aa4d-123cb86d8cde tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:19.774509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7e8c0dcc-499a-4356-aa4d-123cb86d8cde tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.189162 Jan 31 04:46:19.774509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 107/206] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:19 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:19.774509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:19.775578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:19.775578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.775578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:19.775578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.775861 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:19.802996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4c79b54d-3f20-4f3e-8acb-4228f8fc0fd0 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:19.820482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4c79b54d-3f20-4f3e-8acb-4228f8fc0fd0 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.186796 Jan 31 04:46:19.820482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 100/207] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:19 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:19.934577 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:19.934577 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:19.934972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:19.934972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-aae53ff0-c3bf-4f47-9d2f-7bf59f28fdcd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.162292 Jan 31 04:46:19.934972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 108/208] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:19 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:19.935228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-abb45837-49a5-49eb-82fe-0f53c208e711 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:19.935228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-abb45837-49a5-49eb-82fe-0f53c208e711 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:19.935228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-abb45837-49a5-49eb-82fe-0f53c208e711 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.935228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-abb45837-49a5-49eb-82fe-0f53c208e711 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:19.935532 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-abb45837-49a5-49eb-82fe-0f53c208e711 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:19.935532 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-abb45837-49a5-49eb-82fe-0f53c208e711 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:20.077674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-abb45837-49a5-49eb-82fe-0f53c208e711 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:20.085039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-abb45837-49a5-49eb-82fe-0f53c208e711 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1321 microversion: 2.1 time: 0.167514 Jan 31 04:46:20.085601 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 101/209] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:19 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:20.732627 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9c2bfc23-9158-41d4-877b-0a466e3e19bd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:20.733285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9c2bfc23-9158-41d4-877b-0a466e3e19bd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:20.740378 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9c2bfc23-9158-41d4-877b-0a466e3e19bd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:20.740828 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9c2bfc23-9158-41d4-877b-0a466e3e19bd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:20.741645 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9c2bfc23-9158-41d4-877b-0a466e3e19bd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:20.742075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9c2bfc23-9158-41d4-877b-0a466e3e19bd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:20.829431 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3faaf546-dcf4-498b-972f-b0fa8c847e02 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:20.830131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3faaf546-dcf4-498b-972f-b0fa8c847e02 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:20.843846 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3faaf546-dcf4-498b-972f-b0fa8c847e02 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:20.845639 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3faaf546-dcf4-498b-972f-b0fa8c847e02 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:20.846662 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3faaf546-dcf4-498b-972f-b0fa8c847e02 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:20.847137 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3faaf546-dcf4-498b-972f-b0fa8c847e02 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:20.953089 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9c2bfc23-9158-41d4-877b-0a466e3e19bd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:20.968036 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9c2bfc23-9158-41d4-877b-0a466e3e19bd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.238979 Jan 31 04:46:20.969306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 109/210] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:20 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:20.975160 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:20.976308 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:20.987290 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:20.988009 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:20.988966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:20.989760 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:21.064432 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3faaf546-dcf4-498b-972f-b0fa8c847e02 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:21.121979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3faaf546-dcf4-498b-972f-b0fa8c847e02 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1313 microversion: 2.1 time: 0.286920 Jan 31 04:46:21.121979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 102/211] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:20 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:21.125174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ce5ae06f-8d7f-4e63-924c-5a3d5ab8cd9e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:21.127852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ce5ae06f-8d7f-4e63-924c-5a3d5ab8cd9e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:21.138210 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ce5ae06f-8d7f-4e63-924c-5a3d5ab8cd9e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:21.139056 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ce5ae06f-8d7f-4e63-924c-5a3d5ab8cd9e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:21.140451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ce5ae06f-8d7f-4e63-924c-5a3d5ab8cd9e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:21.141107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ce5ae06f-8d7f-4e63-924c-5a3d5ab8cd9e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:21.179290 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:21.188558 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:21.190946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:21.192285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8afb24a8-f0fb-4f3e-9629-31f397706154 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.221734 Jan 31 04:46:21.193018 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 110/212] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:20 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:21.316956 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ce5ae06f-8d7f-4e63-924c-5a3d5ab8cd9e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:21.325544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ce5ae06f-8d7f-4e63-924c-5a3d5ab8cd9e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1514 microversion: 2.1 time: 0.210498 Jan 31 04:46:21.326704 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 103/213] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:21 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:21.344307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b6436613-1da6-44bd-bede-36f0c7400e0e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:21.345304 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b6436613-1da6-44bd-bede-36f0c7400e0e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:21.352158 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6436613-1da6-44bd-bede-36f0c7400e0e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:21.352608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6436613-1da6-44bd-bede-36f0c7400e0e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:21.355993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6436613-1da6-44bd-bede-36f0c7400e0e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:21.357357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6436613-1da6-44bd-bede-36f0c7400e0e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:21.425908 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-b6436613-1da6-44bd-bede-36f0c7400e0e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lazy-loading 'flavor' on Instance uuid c7066f95-24c8-4df3-8703-78616c09fd0e {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:46:21.672186 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b6436613-1da6-44bd-bede-36f0c7400e0e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e/action" status: 200 len: 32 microversion: 2.1 time: 0.332267 Jan 31 04:46:21.673694 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 111/214] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:46:21 2022] POST /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e/action => generated 32 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 04:46:21.682595 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-887a99c3-d97f-4772-b832-f87d7dbeb018 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:21.683335 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-887a99c3-d97f-4772-b832-f87d7dbeb018 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:21.689646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-887a99c3-d97f-4772-b832-f87d7dbeb018 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:21.693511 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-887a99c3-d97f-4772-b832-f87d7dbeb018 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:21.693511 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-887a99c3-d97f-4772-b832-f87d7dbeb018 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:21.693511 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-887a99c3-d97f-4772-b832-f87d7dbeb018 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:21.859177 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-887a99c3-d97f-4772-b832-f87d7dbeb018 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:21.866959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-887a99c3-d97f-4772-b832-f87d7dbeb018 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.188394 Jan 31 04:46:21.870668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 104/215] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:21 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:21.986669 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c56e0b98-a28a-45f9-9629-cd6839eb962d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:21.987414 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c56e0b98-a28a-45f9-9629-cd6839eb962d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:21.993402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c56e0b98-a28a-45f9-9629-cd6839eb962d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:21.993847 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c56e0b98-a28a-45f9-9629-cd6839eb962d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:21.994621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c56e0b98-a28a-45f9-9629-cd6839eb962d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:21.995093 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c56e0b98-a28a-45f9-9629-cd6839eb962d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:22.129077 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3fe2a855-3c6d-41cd-b9c8-e623abd0ad6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:22.129846 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3fe2a855-3c6d-41cd-b9c8-e623abd0ad6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:22.136023 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fe2a855-3c6d-41cd-b9c8-e623abd0ad6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:22.136464 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fe2a855-3c6d-41cd-b9c8-e623abd0ad6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:22.137038 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c56e0b98-a28a-45f9-9629-cd6839eb962d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:22.137236 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fe2a855-3c6d-41cd-b9c8-e623abd0ad6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:22.137661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fe2a855-3c6d-41cd-b9c8-e623abd0ad6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:22.144974 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c56e0b98-a28a-45f9-9629-cd6839eb962d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.162986 Jan 31 04:46:22.145635 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 112/216] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:21 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:22.210196 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:22.211029 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:22.218568 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:22.219648 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:22.220619 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:22.221199 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:22.305023 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3fe2a855-3c6d-41cd-b9c8-e623abd0ad6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:22.309505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3fe2a855-3c6d-41cd-b9c8-e623abd0ad6e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1501 microversion: 2.1 time: 0.184109 Jan 31 04:46:22.312130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 105/217] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:22 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:22.368138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:22.376442 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:22.378061 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:22.379210 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-72d6da87-539e-4f5e-aa6b-2ce267259c67 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.172922 Jan 31 04:46:22.379966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 113/218] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:22 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:22.884650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a5de5dc4-2f63-412a-9d52-cbbde631e3c6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:22.885255 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a5de5dc4-2f63-412a-9d52-cbbde631e3c6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:22.892176 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5de5dc4-2f63-412a-9d52-cbbde631e3c6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:22.892370 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5de5dc4-2f63-412a-9d52-cbbde631e3c6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:22.893142 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5de5dc4-2f63-412a-9d52-cbbde631e3c6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:22.893624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5de5dc4-2f63-412a-9d52-cbbde631e3c6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:23.065073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a5de5dc4-2f63-412a-9d52-cbbde631e3c6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:23.073130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a5de5dc4-2f63-412a-9d52-cbbde631e3c6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.191216 Jan 31 04:46:23.073130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 106/219] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:22 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:23.162137 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-fd66c79a-555a-4afe-9614-bbf9fab75230 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:23.162819 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-fd66c79a-555a-4afe-9614-bbf9fab75230 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:23.168767 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd66c79a-555a-4afe-9614-bbf9fab75230 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:23.169203 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd66c79a-555a-4afe-9614-bbf9fab75230 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:23.169975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd66c79a-555a-4afe-9614-bbf9fab75230 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:23.170390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd66c79a-555a-4afe-9614-bbf9fab75230 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:23.398703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:23.399341 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:23.405888 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:23.409451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:23.409451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:23.409451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:23.473755 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fd66c79a-555a-4afe-9614-bbf9fab75230 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:23.480150 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-fd66c79a-555a-4afe-9614-bbf9fab75230 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.321990 Jan 31 04:46:23.480707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 114/220] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:23 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:23.555597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:23.564359 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:23.565871 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:23.566993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-caa14394-7468-47a5-aa92-3611ba6b03f9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.173439 Jan 31 04:46:23.567541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 107/221] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:23 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:24.089699 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-058a0334-20ac-45c2-8bf0-f418d60a6966 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:24.090378 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-058a0334-20ac-45c2-8bf0-f418d60a6966 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:24.097308 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-058a0334-20ac-45c2-8bf0-f418d60a6966 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:24.097745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-058a0334-20ac-45c2-8bf0-f418d60a6966 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:24.098509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-058a0334-20ac-45c2-8bf0-f418d60a6966 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:24.098964 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-058a0334-20ac-45c2-8bf0-f418d60a6966 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:24.231206 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-058a0334-20ac-45c2-8bf0-f418d60a6966 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:24.238501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-058a0334-20ac-45c2-8bf0-f418d60a6966 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.152695 Jan 31 04:46:24.239079 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 115/222] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:24 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:24.496276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f429df54-d99f-413e-9af3-a7dd49cf6215 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:24.496889 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f429df54-d99f-413e-9af3-a7dd49cf6215 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:24.503406 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f429df54-d99f-413e-9af3-a7dd49cf6215 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:24.503819 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f429df54-d99f-413e-9af3-a7dd49cf6215 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:24.504832 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f429df54-d99f-413e-9af3-a7dd49cf6215 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:24.505257 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f429df54-d99f-413e-9af3-a7dd49cf6215 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:24.585129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:24.585660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:24.591774 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:24.592216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:24.593611 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:24.594132 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:24.641455 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f429df54-d99f-413e-9af3-a7dd49cf6215 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:24.648981 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f429df54-d99f-413e-9af3-a7dd49cf6215 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.156031 Jan 31 04:46:24.658380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 108/223] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:24 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:24.738845 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:24.746632 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:24.748151 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:24.750105 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1d472203-1f75-4463-bc60-0aae4fdb40b6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.168572 Jan 31 04:46:24.750729 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 116/224] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:24 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:25.257059 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4ced7a2b-6691-4480-9c65-1bcb54212d8e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:25.257667 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4ced7a2b-6691-4480-9c65-1bcb54212d8e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:25.263438 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4ced7a2b-6691-4480-9c65-1bcb54212d8e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:25.263880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4ced7a2b-6691-4480-9c65-1bcb54212d8e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:25.264688 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4ced7a2b-6691-4480-9c65-1bcb54212d8e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:25.264688 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4ced7a2b-6691-4480-9c65-1bcb54212d8e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:25.399197 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4ced7a2b-6691-4480-9c65-1bcb54212d8e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:25.408022 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4ced7a2b-6691-4480-9c65-1bcb54212d8e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.155941 Jan 31 04:46:25.408714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 109/225] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:25 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:25.665039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-82aca2d1-0d0d-47c7-96e7-d9b1f386bd0f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:25.665644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-82aca2d1-0d0d-47c7-96e7-d9b1f386bd0f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:25.671890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-82aca2d1-0d0d-47c7-96e7-d9b1f386bd0f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:25.672882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-82aca2d1-0d0d-47c7-96e7-d9b1f386bd0f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:25.673086 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-82aca2d1-0d0d-47c7-96e7-d9b1f386bd0f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:25.673513 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-82aca2d1-0d0d-47c7-96e7-d9b1f386bd0f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:25.768786 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:25.769389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:25.775917 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:25.776383 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:25.777150 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:25.777579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:25.810060 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-82aca2d1-0d0d-47c7-96e7-d9b1f386bd0f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:25.817508 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-82aca2d1-0d0d-47c7-96e7-d9b1f386bd0f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.155998 Jan 31 04:46:25.818082 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 117/226] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:25 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:25.912996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:25.921452 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:25.923051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:25.924291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-50a8eeb9-9875-44ef-a582-30d9fd2087b0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.160161 Jan 31 04:46:25.924848 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 110/227] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:25 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:26.425533 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-25dd5b12-bee6-47fc-87d3-d0c67daa6638 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:26.430480 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-25dd5b12-bee6-47fc-87d3-d0c67daa6638 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:26.437113 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-25dd5b12-bee6-47fc-87d3-d0c67daa6638 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:26.437612 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-25dd5b12-bee6-47fc-87d3-d0c67daa6638 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:26.440660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-25dd5b12-bee6-47fc-87d3-d0c67daa6638 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:26.440660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-25dd5b12-bee6-47fc-87d3-d0c67daa6638 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:26.580119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-25dd5b12-bee6-47fc-87d3-d0c67daa6638 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:26.587343 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-25dd5b12-bee6-47fc-87d3-d0c67daa6638 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.165804 Jan 31 04:46:26.587992 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 118/228] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:26 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:26.834259 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3808d294-2e13-4305-9cb8-6549e38a5d30 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:26.834913 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3808d294-2e13-4305-9cb8-6549e38a5d30 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:26.840541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3808d294-2e13-4305-9cb8-6549e38a5d30 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:26.841119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3808d294-2e13-4305-9cb8-6549e38a5d30 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:26.841953 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3808d294-2e13-4305-9cb8-6549e38a5d30 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:26.842416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3808d294-2e13-4305-9cb8-6549e38a5d30 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:26.947256 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:26.947866 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:26.957327 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:26.958143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:26.958956 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:26.959536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:26.997830 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3808d294-2e13-4305-9cb8-6549e38a5d30 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:27.006223 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3808d294-2e13-4305-9cb8-6549e38a5d30 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1318 microversion: 2.1 time: 0.175577 Jan 31 04:46:27.006782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 111/229] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:26 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:27.101328 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:27.110168 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:27.111699 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:27.112796 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-806fb90d-17be-4f41-97a6-68cc97171e0f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.174648 Jan 31 04:46:27.113352 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 119/230] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:26 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:27.604421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-93c604d6-66b2-4995-b994-b2e9d23a57e7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:27.604907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-93c604d6-66b2-4995-b994-b2e9d23a57e7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:27.611310 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-93c604d6-66b2-4995-b994-b2e9d23a57e7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:27.612091 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-93c604d6-66b2-4995-b994-b2e9d23a57e7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:27.613092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-93c604d6-66b2-4995-b994-b2e9d23a57e7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:27.613522 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-93c604d6-66b2-4995-b994-b2e9d23a57e7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:27.757013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-93c604d6-66b2-4995-b994-b2e9d23a57e7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:27.764566 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-93c604d6-66b2-4995-b994-b2e9d23a57e7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.163776 Jan 31 04:46:27.765307 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 112/231] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:27 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:28.023597 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-bbc0b017-f767-40a7-9008-42d356601844 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:28.024234 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-bbc0b017-f767-40a7-9008-42d356601844 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:28.030023 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bbc0b017-f767-40a7-9008-42d356601844 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:28.030455 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bbc0b017-f767-40a7-9008-42d356601844 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:28.031236 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bbc0b017-f767-40a7-9008-42d356601844 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:28.031660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bbc0b017-f767-40a7-9008-42d356601844 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:28.130530 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:28.131201 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:28.137063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:28.137450 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:28.138218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:28.138647 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:28.176453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-bbc0b017-f767-40a7-9008-42d356601844 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:28.189555 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-bbc0b017-f767-40a7-9008-42d356601844 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1508 microversion: 2.1 time: 0.169465 Jan 31 04:46:28.190123 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 120/232] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:28 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:28.288246 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:28.296785 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:28.298367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:28.299470 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-97528fa8-90cd-4225-97c2-5755420aca90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1406 microversion: 2.20 time: 0.172846 Jan 31 04:46:28.300503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 113/233] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:28 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:28.391285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7f857efc-69a9-4c51-a905-69a5a5d606da tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3b5f948-2ee9-4c25-a53b-1ddb31fbaa5c"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:28.392745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7f857efc-69a9-4c51-a905-69a5a5d606da tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:28.399059 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f857efc-69a9-4c51-a905-69a5a5d606da tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:28.399556 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f857efc-69a9-4c51-a905-69a5a5d606da tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:28.400314 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f857efc-69a9-4c51-a905-69a5a5d606da tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:28.400796 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f857efc-69a9-4c51-a905-69a5a5d606da tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:28.781205 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-751f62f2-fad6-4633-a330-b835afc68cc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:28.782038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-751f62f2-fad6-4633-a330-b835afc68cc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:28.788059 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-751f62f2-fad6-4633-a330-b835afc68cc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:28.788506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-751f62f2-fad6-4633-a330-b835afc68cc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:28.789281 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-751f62f2-fad6-4633-a330-b835afc68cc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:28.789884 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-751f62f2-fad6-4633-a330-b835afc68cc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:28.949464 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-751f62f2-fad6-4633-a330-b835afc68cc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:28.957573 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-751f62f2-fad6-4633-a330-b835afc68cc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.180874 Jan 31 04:46:28.958123 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 114/234] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:28 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:29.320218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:29.321544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:29.328983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:29.329666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:29.330442 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:29.330905 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:29.474700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:29.483665 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:29.485301 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:29.487500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3742c396-e1e6-4de3-9100-ca6af976adbc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1597 microversion: 2.20 time: 0.172551 Jan 31 04:46:29.487500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 115/235] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:29 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1597 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:29.506768 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f21874c6-a28d-4011-abab-c68d78876861 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:29.507453 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f21874c6-a28d-4011-abab-c68d78876861 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:29.513541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f21874c6-a28d-4011-abab-c68d78876861 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:29.521771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7f857efc-69a9-4c51-a905-69a5a5d606da tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "POST /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.134600 Jan 31 04:46:29.522421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 121/236] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:46:28 2022] POST /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349/os-volume_attachments => generated 194 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:46:29.522513 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f21874c6-a28d-4011-abab-c68d78876861 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:29.523443 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f21874c6-a28d-4011-abab-c68d78876861 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:29.523876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f21874c6-a28d-4011-abab-c68d78876861 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:29.652063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f21874c6-a28d-4011-abab-c68d78876861 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.150276 Jan 31 04:46:29.652670 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 116/237] 10.222.0.21 () {60 vars in 1315 bytes} [Mon Jan 31 04:46:29 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 04:46:29.975863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1ef65731-00ee-4c7f-900d-80c429ae9423 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:29.976824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1ef65731-00ee-4c7f-900d-80c429ae9423 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:29.994106 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ef65731-00ee-4c7f-900d-80c429ae9423 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:29.994594 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ef65731-00ee-4c7f-900d-80c429ae9423 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:29.995609 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ef65731-00ee-4c7f-900d-80c429ae9423 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:29.996048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ef65731-00ee-4c7f-900d-80c429ae9423 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:30.226413 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1ef65731-00ee-4c7f-900d-80c429ae9423 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:30.236583 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1ef65731-00ee-4c7f-900d-80c429ae9423 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.264880 Jan 31 04:46:30.246299 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 122/238] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:29 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:31.237566 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:31.238506 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-07c82356-2208-4060-8d5f-2ccbae3f9298 req-3c4fce20-ff07-472f-9963-79b443ff27ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde1517d-e13d-455c-a8dd-0119bb29148b", "tag": "2eade66b-918f-4c8e-a64c-60d0ce7921a5"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:31.239353 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:31.240339 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:46:31.240339 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:46:31.246386 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:31.246843 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:31.247776 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:31.248288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:31.250284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-07c82356-2208-4060-8d5f-2ccbae3f9298 req-3c4fce20-ff07-472f-9963-79b443ff27ef service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:31.254862 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-07c82356-2208-4060-8d5f-2ccbae3f9298 req-3c4fce20-ff07-472f-9963-79b443ff27ef service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:31.269990 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-07c82356-2208-4060-8d5f-2ccbae3f9298 req-3c4fce20-ff07-472f-9963-79b443ff27ef service nova] Creating event network-changed:2eade66b-918f-4c8e-a64c-60d0ce7921a5 for instance dde1517d-e13d-455c-a8dd-0119bb29148b on hv-cinder-82660 Jan 31 04:46:31.275210 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-07c82356-2208-4060-8d5f-2ccbae3f9298 req-3c4fce20-ff07-472f-9963-79b443ff27ef service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041091 Jan 31 04:46:31.276369 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 123/239] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:46:31.283328 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9f4a3b8d-0ac3-461c-b5f7-fb3363a491be tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:31.284503 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9f4a3b8d-0ac3-461c-b5f7-fb3363a491be tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:31.290497 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9f4a3b8d-0ac3-461c-b5f7-fb3363a491be tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:31.291211 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9f4a3b8d-0ac3-461c-b5f7-fb3363a491be tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:31.291990 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9f4a3b8d-0ac3-461c-b5f7-fb3363a491be tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:31.292439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9f4a3b8d-0ac3-461c-b5f7-fb3363a491be tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:31.450563 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:31.462525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:31.464315 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:31.465612 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-56fcdf26-4088-4670-aa74-eda9b4a7898d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1597 microversion: 2.20 time: 0.235005 Jan 31 04:46:31.477604 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 117/240] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:31 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1597 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:31.491553 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9f4a3b8d-0ac3-461c-b5f7-fb3363a491be tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:31.499842 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9f4a3b8d-0ac3-461c-b5f7-fb3363a491be tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.220537 Jan 31 04:46:31.499842 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 124/241] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:31 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:31.587548 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bd6e15a0-1370-4ce9-84f2-f117f21f0d13 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ea1a7f6-be9f-45f4-bf3e-e5abca5a406f"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:31.588977 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bd6e15a0-1370-4ce9-84f2-f117f21f0d13 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:31.595810 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd6e15a0-1370-4ce9-84f2-f117f21f0d13 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:31.596407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd6e15a0-1370-4ce9-84f2-f117f21f0d13 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:31.597481 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd6e15a0-1370-4ce9-84f2-f117f21f0d13 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:31.598057 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd6e15a0-1370-4ce9-84f2-f117f21f0d13 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:32.485085 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:32.485690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:32.492065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:32.492504 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:32.493286 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:32.493717 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:32.631173 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:32.640171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:32.641700 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:32.643092 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3f312999-31da-444e-b294-5c87b880e4d4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1597 microversion: 2.20 time: 0.162368 Jan 31 04:46:32.643646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 125/242] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:32 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1597 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:32.647822 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-dded5a02-34f6-485b-bd14-cdf542927a8b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:32.648415 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-dded5a02-34f6-485b-bd14-cdf542927a8b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:32.655229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dded5a02-34f6-485b-bd14-cdf542927a8b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:32.655656 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dded5a02-34f6-485b-bd14-cdf542927a8b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:32.656430 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dded5a02-34f6-485b-bd14-cdf542927a8b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:32.656864 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dded5a02-34f6-485b-bd14-cdf542927a8b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:32.798087 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dded5a02-34f6-485b-bd14-cdf542927a8b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:32.805634 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-dded5a02-34f6-485b-bd14-cdf542927a8b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.161035 Jan 31 04:46:32.806181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 126/243] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:32 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:33.663142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:33.663142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:33.668835 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:33.669283 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:33.670070 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:33.670500 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:33.809974 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:33.818427 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:33.819969 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:33.821221 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e6bfef82-d4cc-4de4-b973-46e0c6f78bd5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1597 microversion: 2.20 time: 0.163698 Jan 31 04:46:33.821798 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 127/244] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:33 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1597 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:33.826384 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-557ce271-573a-479e-be51-4742725050cd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:33.832182 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-557ce271-573a-479e-be51-4742725050cd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:33.832710 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-557ce271-573a-479e-be51-4742725050cd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:33.833155 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-557ce271-573a-479e-be51-4742725050cd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:33.833922 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-557ce271-573a-479e-be51-4742725050cd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:33.834357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-557ce271-573a-479e-be51-4742725050cd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:33.970390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-557ce271-573a-479e-be51-4742725050cd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:33.977626 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-557ce271-573a-479e-be51-4742725050cd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.154839 Jan 31 04:46:33.978186 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 128/245] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:33 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:34.843395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:34.843395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:34.845764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:34.846202 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:34.846994 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:34.847456 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:34.979103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:34.986615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:34.988122 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:34.989240 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cb6c07ba-2c1f-49b5-9e85-1e0c3cc874f7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1597 microversion: 2.20 time: 0.154021 Jan 31 04:46:34.989876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 129/246] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:34 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:46:34.994064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-153e9319-f786-40ba-bafb-2df7ac9618b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:34.994646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-153e9319-f786-40ba-bafb-2df7ac9618b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:35.000096 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-153e9319-f786-40ba-bafb-2df7ac9618b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:35.001201 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-153e9319-f786-40ba-bafb-2df7ac9618b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:35.002410 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-153e9319-f786-40ba-bafb-2df7ac9618b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:35.002875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-153e9319-f786-40ba-bafb-2df7ac9618b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:35.140792 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-153e9319-f786-40ba-bafb-2df7ac9618b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:35.149044 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-153e9319-f786-40ba-bafb-2df7ac9618b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.158180 Jan 31 04:46:35.149606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 130/247] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:34 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:36.008510 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:36.009943 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:36.020062 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:36.020809 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:36.028880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:36.029761 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:36.433383 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:36.445400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:36.446949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:36.448113 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-436d109c-ba57-4112-b88f-6dd58ff1c33f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1597 microversion: 2.20 time: 0.444046 Jan 31 04:46:36.448657 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 131/248] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:36 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1597 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:36.455955 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a17000e6-65c3-4dd2-a73d-f5d78aca9a38 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:36.456926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a17000e6-65c3-4dd2-a73d-f5d78aca9a38 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:36.476663 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a17000e6-65c3-4dd2-a73d-f5d78aca9a38 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:36.477689 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a17000e6-65c3-4dd2-a73d-f5d78aca9a38 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:36.478814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a17000e6-65c3-4dd2-a73d-f5d78aca9a38 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:36.479144 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a17000e6-65c3-4dd2-a73d-f5d78aca9a38 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:36.611013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bd6e15a0-1370-4ce9-84f2-f117f21f0d13 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.026612 Jan 31 04:46:36.611845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 118/249] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:46:31 2022] POST /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 194 bytes in 5029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:46:36.719269 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a17000e6-65c3-4dd2-a73d-f5d78aca9a38 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:36.729310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a17000e6-65c3-4dd2-a73d-f5d78aca9a38 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.276860 Jan 31 04:46:36.731511 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 132/250] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:36 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:37.502743 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:37.502743 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:37.502743 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:37.502743 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:37.503370 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:37.503370 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:37.618021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:37.627987 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:37.629756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:37.631737 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-740beb4a-7710-409d-89b7-ab1867eb95af tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1716 microversion: 2.20 time: 0.169927 Jan 31 04:46:37.632319 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 119/251] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:46:37 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:46:37.649680 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-632fdf23-6cea-48c7-a18b-e6741b1b0679 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:37.650293 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-632fdf23-6cea-48c7-a18b-e6741b1b0679 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:37.657766 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-632fdf23-6cea-48c7-a18b-e6741b1b0679 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:37.658222 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-632fdf23-6cea-48c7-a18b-e6741b1b0679 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:37.659264 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-632fdf23-6cea-48c7-a18b-e6741b1b0679 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:37.659697 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-632fdf23-6cea-48c7-a18b-e6741b1b0679 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:37.686764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-632fdf23-6cea-48c7-a18b-e6741b1b0679 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/ips" status: 200 len: 151 microversion: 2.20 time: 0.041480 Jan 31 04:46:37.687768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 133/252] 10.222.0.21 () {60 vars in 1288 bytes} [Mon Jan 31 04:46:37 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:46:37.747814 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-64272842-506c-43a5-8b01-3c38ea3c693f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:37.748690 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-64272842-506c-43a5-8b01-3c38ea3c693f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:37.756941 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-64272842-506c-43a5-8b01-3c38ea3c693f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:37.757601 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-64272842-506c-43a5-8b01-3c38ea3c693f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:37.758391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-64272842-506c-43a5-8b01-3c38ea3c693f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:37.758845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-64272842-506c-43a5-8b01-3c38ea3c693f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:37.913299 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-64272842-506c-43a5-8b01-3c38ea3c693f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:37.924369 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-64272842-506c-43a5-8b01-3c38ea3c693f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.180744 Jan 31 04:46:37.925316 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 120/253] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:37 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:38.941493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cfe2a60b-4b9e-41e2-8a5f-2ed462796b51 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:38.942094 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cfe2a60b-4b9e-41e2-8a5f-2ed462796b51 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:38.948710 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cfe2a60b-4b9e-41e2-8a5f-2ed462796b51 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:38.949166 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cfe2a60b-4b9e-41e2-8a5f-2ed462796b51 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:38.949950 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cfe2a60b-4b9e-41e2-8a5f-2ed462796b51 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:38.953155 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cfe2a60b-4b9e-41e2-8a5f-2ed462796b51 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:39.099773 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cfe2a60b-4b9e-41e2-8a5f-2ed462796b51 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:39.107259 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cfe2a60b-4b9e-41e2-8a5f-2ed462796b51 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.169864 Jan 31 04:46:39.107895 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 134/254] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:38 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:40.124173 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-65f53356-dc5b-44cb-90d1-af08d26b5ff3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:40.124885 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-65f53356-dc5b-44cb-90d1-af08d26b5ff3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:40.132763 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65f53356-dc5b-44cb-90d1-af08d26b5ff3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:40.133468 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65f53356-dc5b-44cb-90d1-af08d26b5ff3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:40.134446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65f53356-dc5b-44cb-90d1-af08d26b5ff3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:40.135231 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65f53356-dc5b-44cb-90d1-af08d26b5ff3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:40.276949 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-65f53356-dc5b-44cb-90d1-af08d26b5ff3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:40.284671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-65f53356-dc5b-44cb-90d1-af08d26b5ff3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.164229 Jan 31 04:46:40.285240 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 121/255] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:40 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:41.301984 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6503a939-d111-4028-9714-5f6f06160b77 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:41.302637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6503a939-d111-4028-9714-5f6f06160b77 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:41.308827 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6503a939-d111-4028-9714-5f6f06160b77 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:41.309275 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6503a939-d111-4028-9714-5f6f06160b77 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:41.310045 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6503a939-d111-4028-9714-5f6f06160b77 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:41.310482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6503a939-d111-4028-9714-5f6f06160b77 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:41.448237 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6503a939-d111-4028-9714-5f6f06160b77 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:41.456012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6503a939-d111-4028-9714-5f6f06160b77 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.158220 Jan 31 04:46:41.456574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 135/256] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:41 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:42.472566 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-832cc916-521d-42fe-872a-82c5699222fb tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:42.473171 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-832cc916-521d-42fe-872a-82c5699222fb tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:42.479779 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-832cc916-521d-42fe-872a-82c5699222fb tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:42.480229 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-832cc916-521d-42fe-872a-82c5699222fb tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:42.481167 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-832cc916-521d-42fe-872a-82c5699222fb tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:42.481647 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-832cc916-521d-42fe-872a-82c5699222fb tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:42.613959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-832cc916-521d-42fe-872a-82c5699222fb tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:42.621162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-832cc916-521d-42fe-872a-82c5699222fb tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.152378 Jan 31 04:46:42.621768 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 122/257] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:42 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:43.639975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3efccf13-a302-49d6-b5c0-ca0856b15825 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:43.640580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3efccf13-a302-49d6-b5c0-ca0856b15825 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:43.647332 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3efccf13-a302-49d6-b5c0-ca0856b15825 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:43.647777 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3efccf13-a302-49d6-b5c0-ca0856b15825 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:43.648548 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3efccf13-a302-49d6-b5c0-ca0856b15825 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:43.648980 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3efccf13-a302-49d6-b5c0-ca0856b15825 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:43.784493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3efccf13-a302-49d6-b5c0-ca0856b15825 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:43.792217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3efccf13-a302-49d6-b5c0-ca0856b15825 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.156292 Jan 31 04:46:43.793011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 136/258] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:43 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:44.807983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8aa47cc3-59dc-4434-a6d0-41520694dcf1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:44.813589 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8aa47cc3-59dc-4434-a6d0-41520694dcf1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:44.815306 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8aa47cc3-59dc-4434-a6d0-41520694dcf1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:44.815766 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8aa47cc3-59dc-4434-a6d0-41520694dcf1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:44.816520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8aa47cc3-59dc-4434-a6d0-41520694dcf1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:44.816996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8aa47cc3-59dc-4434-a6d0-41520694dcf1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:44.950502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8aa47cc3-59dc-4434-a6d0-41520694dcf1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:44.958669 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8aa47cc3-59dc-4434-a6d0-41520694dcf1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.154104 Jan 31 04:46:44.959325 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 123/259] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:44 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:45.975887 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3a7e841d-c0c0-48e6-b3bb-3916d282cb7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:45.975887 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3a7e841d-c0c0-48e6-b3bb-3916d282cb7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:45.982407 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3a7e841d-c0c0-48e6-b3bb-3916d282cb7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:45.982678 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3a7e841d-c0c0-48e6-b3bb-3916d282cb7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:45.983540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3a7e841d-c0c0-48e6-b3bb-3916d282cb7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:45.983984 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3a7e841d-c0c0-48e6-b3bb-3916d282cb7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:46.120421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3a7e841d-c0c0-48e6-b3bb-3916d282cb7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:46.127658 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3a7e841d-c0c0-48e6-b3bb-3916d282cb7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.156141 Jan 31 04:46:46.128253 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 137/260] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:45 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:47.145171 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ad6166ef-91d2-4be8-a6c6-58bd49e543a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:47.145788 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ad6166ef-91d2-4be8-a6c6-58bd49e543a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:47.152313 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad6166ef-91d2-4be8-a6c6-58bd49e543a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:47.152797 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad6166ef-91d2-4be8-a6c6-58bd49e543a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:47.158932 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad6166ef-91d2-4be8-a6c6-58bd49e543a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:47.158932 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad6166ef-91d2-4be8-a6c6-58bd49e543a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:47.311551 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ad6166ef-91d2-4be8-a6c6-58bd49e543a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:47.319892 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ad6166ef-91d2-4be8-a6c6-58bd49e543a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.179383 Jan 31 04:46:47.327012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 124/261] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:47 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:48.336526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-633bc210-757a-47ef-a1d0-f47f49bdf42d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:48.337133 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-633bc210-757a-47ef-a1d0-f47f49bdf42d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:48.343441 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-633bc210-757a-47ef-a1d0-f47f49bdf42d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:48.343887 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-633bc210-757a-47ef-a1d0-f47f49bdf42d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:48.344665 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-633bc210-757a-47ef-a1d0-f47f49bdf42d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:48.345097 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-633bc210-757a-47ef-a1d0-f47f49bdf42d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:48.477712 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-633bc210-757a-47ef-a1d0-f47f49bdf42d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:48.484950 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-633bc210-757a-47ef-a1d0-f47f49bdf42d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.152094 Jan 31 04:46:48.485509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 138/262] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:48 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:49.500852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9b86b83a-4b39-4a06-a434-7bf66489697b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:49.501486 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9b86b83a-4b39-4a06-a434-7bf66489697b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:49.507851 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9b86b83a-4b39-4a06-a434-7bf66489697b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:49.508293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9b86b83a-4b39-4a06-a434-7bf66489697b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:49.509051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9b86b83a-4b39-4a06-a434-7bf66489697b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:49.509646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9b86b83a-4b39-4a06-a434-7bf66489697b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:49.620338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-900f7500-09da-4429-acf0-a22c5984f5c2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:49.620857 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-900f7500-09da-4429-acf0-a22c5984f5c2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:49.627806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-900f7500-09da-4429-acf0-a22c5984f5c2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:49.628251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-900f7500-09da-4429-acf0-a22c5984f5c2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:49.629061 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-900f7500-09da-4429-acf0-a22c5984f5c2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:49.629736 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-900f7500-09da-4429-acf0-a22c5984f5c2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:49.653218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9b86b83a-4b39-4a06-a434-7bf66489697b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:49.654371 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-900f7500-09da-4429-acf0-a22c5984f5c2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:46:49.662025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9b86b83a-4b39-4a06-a434-7bf66489697b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.164667 Jan 31 04:46:49.662699 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 125/263] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:49 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:50.006318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-900f7500-09da-4429-acf0-a22c5984f5c2 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 204 len: 0 microversion: 2.1 time: 0.389310 Jan 31 04:46:50.007005 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 139/264] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:46:49 2022] DELETE /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 31 04:46:50.015259 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f9ac2077-dfcd-4766-afaf-bd9ce8052609 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:50.015478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f9ac2077-dfcd-4766-afaf-bd9ce8052609 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:50.022049 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f9ac2077-dfcd-4766-afaf-bd9ce8052609 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:50.022651 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f9ac2077-dfcd-4766-afaf-bd9ce8052609 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:50.023493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f9ac2077-dfcd-4766-afaf-bd9ce8052609 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:50.024010 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f9ac2077-dfcd-4766-afaf-bd9ce8052609 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:50.171728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f9ac2077-dfcd-4766-afaf-bd9ce8052609 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:50.182642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f9ac2077-dfcd-4766-afaf-bd9ce8052609 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1553 microversion: 2.1 time: 0.171357 Jan 31 04:46:50.183242 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 126/265] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:50 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:50.678881 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0e711fe4-100a-4117-a04b-990772cf1b43 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:50.679569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0e711fe4-100a-4117-a04b-990772cf1b43 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:50.685732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0e711fe4-100a-4117-a04b-990772cf1b43 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:50.686170 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0e711fe4-100a-4117-a04b-990772cf1b43 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:50.687057 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0e711fe4-100a-4117-a04b-990772cf1b43 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:50.687487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0e711fe4-100a-4117-a04b-990772cf1b43 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:50.831403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0e711fe4-100a-4117-a04b-990772cf1b43 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:50.839020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0e711fe4-100a-4117-a04b-990772cf1b43 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.164030 Jan 31 04:46:50.839579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 140/266] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:50 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:46:51.199816 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6e968093-630f-4306-a04e-9cdd9dd44b51 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:51.200432 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6e968093-630f-4306-a04e-9cdd9dd44b51 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:51.207848 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6e968093-630f-4306-a04e-9cdd9dd44b51 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:51.208291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6e968093-630f-4306-a04e-9cdd9dd44b51 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:51.209055 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6e968093-630f-4306-a04e-9cdd9dd44b51 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:51.209485 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6e968093-630f-4306-a04e-9cdd9dd44b51 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:51.346299 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6e968093-630f-4306-a04e-9cdd9dd44b51 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:51.354270 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6e968093-630f-4306-a04e-9cdd9dd44b51 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1553 microversion: 2.1 time: 0.158063 Jan 31 04:46:51.354869 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 127/267] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:51 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:51.855827 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-50a4b82c-31f4-409c-accd-2225dd6d7529 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:51.856437 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-50a4b82c-31f4-409c-accd-2225dd6d7529 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:51.868270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-50a4b82c-31f4-409c-accd-2225dd6d7529 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:51.868270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-50a4b82c-31f4-409c-accd-2225dd6d7529 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:51.868270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-50a4b82c-31f4-409c-accd-2225dd6d7529 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:51.868270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-50a4b82c-31f4-409c-accd-2225dd6d7529 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:52.007307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-50a4b82c-31f4-409c-accd-2225dd6d7529 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:52.015414 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-50a4b82c-31f4-409c-accd-2225dd6d7529 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.163207 Jan 31 04:46:52.016067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 141/268] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:51 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:52.371580 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-26eff8b4-28b0-4fb9-bea9-2d2e211d5204 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:52.372261 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-26eff8b4-28b0-4fb9-bea9-2d2e211d5204 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:52.378581 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-26eff8b4-28b0-4fb9-bea9-2d2e211d5204 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:52.379118 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-26eff8b4-28b0-4fb9-bea9-2d2e211d5204 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:52.380146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-26eff8b4-28b0-4fb9-bea9-2d2e211d5204 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:52.380579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-26eff8b4-28b0-4fb9-bea9-2d2e211d5204 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:52.678760 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-26eff8b4-28b0-4fb9-bea9-2d2e211d5204 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:52.687482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-26eff8b4-28b0-4fb9-bea9-2d2e211d5204 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1553 microversion: 2.1 time: 0.319666 Jan 31 04:46:52.688048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 128/269] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:52 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1553 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:53.032963 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a40000cc-5fb1-4660-9f2f-b1498f456003 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:53.033949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a40000cc-5fb1-4660-9f2f-b1498f456003 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:53.042978 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a40000cc-5fb1-4660-9f2f-b1498f456003 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:53.044797 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a40000cc-5fb1-4660-9f2f-b1498f456003 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:53.044797 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a40000cc-5fb1-4660-9f2f-b1498f456003 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:53.044797 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a40000cc-5fb1-4660-9f2f-b1498f456003 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:53.208854 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a40000cc-5fb1-4660-9f2f-b1498f456003 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:53.216277 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a40000cc-5fb1-4660-9f2f-b1498f456003 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.187098 Jan 31 04:46:53.216926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 142/270] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:53 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:53.704905 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4d546595-825f-48af-97ae-27e37175efdd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:53.705598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4d546595-825f-48af-97ae-27e37175efdd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:53.711925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d546595-825f-48af-97ae-27e37175efdd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:53.712375 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d546595-825f-48af-97ae-27e37175efdd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:53.713154 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d546595-825f-48af-97ae-27e37175efdd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:53.713607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d546595-825f-48af-97ae-27e37175efdd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:53.869293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4d546595-825f-48af-97ae-27e37175efdd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:53.878009 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4d546595-825f-48af-97ae-27e37175efdd tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1553 microversion: 2.1 time: 0.177076 Jan 31 04:46:53.878624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 129/271] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:53 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:54.234745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-17f5601d-5fb9-44cf-8921-a0b2144743b1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:54.235528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-17f5601d-5fb9-44cf-8921-a0b2144743b1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:54.246042 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-17f5601d-5fb9-44cf-8921-a0b2144743b1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:54.246369 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-17f5601d-5fb9-44cf-8921-a0b2144743b1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:54.247951 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-17f5601d-5fb9-44cf-8921-a0b2144743b1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:54.248316 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-17f5601d-5fb9-44cf-8921-a0b2144743b1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:54.498661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-17f5601d-5fb9-44cf-8921-a0b2144743b1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:54.507098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-17f5601d-5fb9-44cf-8921-a0b2144743b1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.277457 Jan 31 04:46:54.507675 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 143/272] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:54 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:54.693202 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-a31cad75-8be0-4bcc-a75c-6fd8ff5129e1 req-e2041aef-d374-4d9e-a1be-cf44f6b38d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7ff86e-085c-4f11-8f98-0591b022b349", "name": "network-vif-deleted", "tag": "b553d9db-0bd8-4984-9092-941cff441538"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:54.695113 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:46:54.695113 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:46:54.702997 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-a31cad75-8be0-4bcc-a75c-6fd8ff5129e1 req-e2041aef-d374-4d9e-a1be-cf44f6b38d8a service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:54.703655 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-a31cad75-8be0-4bcc-a75c-6fd8ff5129e1 req-e2041aef-d374-4d9e-a1be-cf44f6b38d8a service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:54.716800 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-a31cad75-8be0-4bcc-a75c-6fd8ff5129e1 req-e2041aef-d374-4d9e-a1be-cf44f6b38d8a service nova] Creating event network-vif-deleted:b553d9db-0bd8-4984-9092-941cff441538 for instance 2c7ff86e-085c-4f11-8f98-0591b022b349 on hv-cinder-82660 Jan 31 04:46:54.722324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-a31cad75-8be0-4bcc-a75c-6fd8ff5129e1 req-e2041aef-d374-4d9e-a1be-cf44f6b38d8a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034546 Jan 31 04:46:54.723414 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 130/273] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:46:54.899770 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c65040ab-5e86-4aa3-9218-021d3c454eb9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:54.900768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c65040ab-5e86-4aa3-9218-021d3c454eb9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:54.906756 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c65040ab-5e86-4aa3-9218-021d3c454eb9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:54.907168 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c65040ab-5e86-4aa3-9218-021d3c454eb9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:54.908021 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c65040ab-5e86-4aa3-9218-021d3c454eb9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:54.908479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c65040ab-5e86-4aa3-9218-021d3c454eb9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:54.974626 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c65040ab-5e86-4aa3-9218-021d3c454eb9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:54.982904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c65040ab-5e86-4aa3-9218-021d3c454eb9 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1344 microversion: 2.1 time: 0.091506 Jan 31 04:46:54.983633 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 144/274] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:54 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:55.527422 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-308c5f17-a044-480d-8814-32e1d3665d45 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:55.528621 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-308c5f17-a044-480d-8814-32e1d3665d45 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:55.538077 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-308c5f17-a044-480d-8814-32e1d3665d45 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:55.538998 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-308c5f17-a044-480d-8814-32e1d3665d45 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:55.540131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-308c5f17-a044-480d-8814-32e1d3665d45 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:55.540829 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-308c5f17-a044-480d-8814-32e1d3665d45 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:55.689989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-308c5f17-a044-480d-8814-32e1d3665d45 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:55.698367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-308c5f17-a044-480d-8814-32e1d3665d45 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.176675 Jan 31 04:46:55.698961 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 131/275] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:55 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:56.003419 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:56.004029 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:56.010584 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:56.011064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:56.011834 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:56.012259 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:56.044382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:56.044830 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:56.045279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lazy-loading 'fault' on Instance uuid 2c7ff86e-085c-4f11-8f98-0591b022b349 {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:46:56.089897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07cb89be4584e6b97df973c88daa6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc69e55b9254a6ba45b32be8fc0df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:56.098614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ae3b731d-20ac-4056-b2fd-9564bcb28b72 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 200 len: 1349 microversion: 2.1 time: 0.101229 Jan 31 04:46:56.099225 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 145/276] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:55 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:56.715622 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9e61536b-e4f7-439d-a051-d2ea0c828969 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:56.716188 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9e61536b-e4f7-439d-a051-d2ea0c828969 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:56.722696 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e61536b-e4f7-439d-a051-d2ea0c828969 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:56.723200 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e61536b-e4f7-439d-a051-d2ea0c828969 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:56.724014 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e61536b-e4f7-439d-a051-d2ea0c828969 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:56.724456 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e61536b-e4f7-439d-a051-d2ea0c828969 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:56.867113 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9e61536b-e4f7-439d-a051-d2ea0c828969 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:56.877520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9e61536b-e4f7-439d-a051-d2ea0c828969 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.164665 Jan 31 04:46:56.882104 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 132/277] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:56 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:57.119991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:57.124309 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:57.132343 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:57.132793 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:57.133604 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:57.134050 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:57.148485 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] HTTP exception thrown: Instance 2c7ff86e-085c-4f11-8f98-0591b022b349 could not be found. Jan 31 04:46:57.149316 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Returning 404 to user: Instance 2c7ff86e-085c-4f11-8f98-0591b022b349 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:46:57.150175 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-18dc0b1e-7d6e-44d0-9a1c-2ed8f14c712e tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 404 len: 111 microversion: 2.1 time: 0.037639 Jan 31 04:46:57.154031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 146/278] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:57 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 04:46:57.261570 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:57.262679 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:57.277085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:57.277085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:57.277085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:57.277085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:57.285718 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] HTTP exception thrown: Instance 2c7ff86e-085c-4f11-8f98-0591b022b349 could not be found. Jan 31 04:46:57.286320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Returning 404 to user: Instance 2c7ff86e-085c-4f11-8f98-0591b022b349 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:46:57.287268 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-835c5b78-6433-415d-a90c-3bf30b6ad815 tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029383 Jan 31 04:46:57.287856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 133/279] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:46:57 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 04:46:57.897650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7b70e13f-e09c-4c1e-8364-872d7f22e53c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:57.898335 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7b70e13f-e09c-4c1e-8364-872d7f22e53c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:57.904449 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7b70e13f-e09c-4c1e-8364-872d7f22e53c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:57.905027 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7b70e13f-e09c-4c1e-8364-872d7f22e53c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:57.905767 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7b70e13f-e09c-4c1e-8364-872d7f22e53c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:57.906204 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7b70e13f-e09c-4c1e-8364-872d7f22e53c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:58.069413 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7b70e13f-e09c-4c1e-8364-872d7f22e53c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:58.080171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7b70e13f-e09c-4c1e-8364-872d7f22e53c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.185595 Jan 31 04:46:58.082361 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 147/280] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:57 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:58.341909 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-127298396", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "58128fc4-bc4f-417c-908e-383736354847"}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:46:58.645421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:58.645928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:58.655772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:58.656224 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:58.657007 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:58.658304 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:58.674157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] HTTP exception thrown: Instance 2c7ff86e-085c-4f11-8f98-0591b022b349 could not be found. Jan 31 04:46:58.674738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Returning 404 to user: Instance 2c7ff86e-085c-4f11-8f98-0591b022b349 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:46:58.675581 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1b19ba98-a42e-4376-8f15-557981429efe tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 404 len: 111 microversion: 2.1 time: 0.034402 Jan 31 04:46:58.676118 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 148/281] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:46:58 2022] DELETE /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:46:58.684220 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:58.684891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] [instance: 2c7ff86e-085c-4f11-8f98-0591b022b349] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:58.691423 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:58.691981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:58.692844 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:58.693337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:58.711171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] HTTP exception thrown: Instance 2c7ff86e-085c-4f11-8f98-0591b022b349 could not be found. Jan 31 04:46:58.711795 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] Returning 404 to user: Instance 2c7ff86e-085c-4f11-8f98-0591b022b349 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:46:58.712609 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-14c8d37f-81a6-4393-9ded-7354cfc1721a tempest-DeleteServersTestJSON-1492391953 tempest-DeleteServersTestJSON-1492391953-project] 10.222.0.21 "GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349" status: 404 len: 111 microversion: 2.1 time: 0.032453 Jan 31 04:46:58.713159 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 149/282] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:58 2022] GET /compute/v2.1/servers/2c7ff86e-085c-4f11-8f98-0591b022b349 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 04:46:59.099191 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d9606e4b-e17b-44fe-b584-943ebf74e844 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:46:59.099311 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d9606e4b-e17b-44fe-b584-943ebf74e844 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:46:59.114693 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d9606e4b-e17b-44fe-b584-943ebf74e844 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:59.116582 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d9606e4b-e17b-44fe-b584-943ebf74e844 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:59.117482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d9606e4b-e17b-44fe-b584-943ebf74e844 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:59.120019 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d9606e4b-e17b-44fe-b584-943ebf74e844 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:59.281593 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] validate_networks() for [('58128fc4-bc4f-417c-908e-383736354847', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:46:59.479744 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d9606e4b-e17b-44fe-b584-943ebf74e844 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:46:59.498010 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d9606e4b-e17b-44fe-b584-943ebf74e844 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.403679 Jan 31 04:46:59.508046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 150/283] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:46:59 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:46:59.939917 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:46:59.940542 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:46:59.941070 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:46:59.941517 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:46:59.941926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:46:59.951672 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:59.952152 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:59.956528 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:46:59.956528 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:46:59.974131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Getting quotas for project 41828fbc91c740cfbec65e04e92a4ecc. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:46:59.979547 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Getting quotas for user 6a6f7f126c2a4cbe80f029f352c4cafd and project 41828fbc91c740cfbec65e04e92a4ecc. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:46:59.993499 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:46:59.996780 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:47:00.170669 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-72c069aa-b5bf-42d0-b42d-75b870c0a4a7 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.833219 Jan 31 04:47:00.171391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 134/284] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:47:00.191903 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-506b648c-65e6-4d97-ad49-0a85b680312e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:00.192535 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-506b648c-65e6-4d97-ad49-0a85b680312e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:00.249357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-506b648c-65e6-4d97-ad49-0a85b680312e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:00.262371 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-506b648c-65e6-4d97-ad49-0a85b680312e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1217 microversion: 2.1 time: 0.084261 Jan 31 04:47:00.267777 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 151/285] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:00 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:00.515337 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b40beb21-040f-4b78-9230-7498e90663f0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:00.516334 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b40beb21-040f-4b78-9230-7498e90663f0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:00.525400 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b40beb21-040f-4b78-9230-7498e90663f0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:00.525850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b40beb21-040f-4b78-9230-7498e90663f0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:00.530543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b40beb21-040f-4b78-9230-7498e90663f0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:00.536224 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b40beb21-040f-4b78-9230-7498e90663f0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:00.702723 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b40beb21-040f-4b78-9230-7498e90663f0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:00.711044 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b40beb21-040f-4b78-9230-7498e90663f0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.199774 Jan 31 04:47:00.711696 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 135/286] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:00 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:01.282142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d03ed81b-a673-4ab9-85d9-af00c034f845 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:01.283764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d03ed81b-a673-4ab9-85d9-af00c034f845 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:01.292678 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d03ed81b-a673-4ab9-85d9-af00c034f845 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:01.293246 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d03ed81b-a673-4ab9-85d9-af00c034f845 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:01.294172 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d03ed81b-a673-4ab9-85d9-af00c034f845 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:01.294704 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d03ed81b-a673-4ab9-85d9-af00c034f845 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:01.360195 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d03ed81b-a673-4ab9-85d9-af00c034f845 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:01.368513 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d03ed81b-a673-4ab9-85d9-af00c034f845 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1221 microversion: 2.1 time: 0.091684 Jan 31 04:47:01.369072 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 152/287] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:01 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:01.732296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9458e4c6-1c6d-4959-8395-299594659f84 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:01.732910 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9458e4c6-1c6d-4959-8395-299594659f84 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:01.745506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9458e4c6-1c6d-4959-8395-299594659f84 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:01.745955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9458e4c6-1c6d-4959-8395-299594659f84 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:01.746738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9458e4c6-1c6d-4959-8395-299594659f84 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:01.747196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9458e4c6-1c6d-4959-8395-299594659f84 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:01.921694 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9458e4c6-1c6d-4959-8395-299594659f84 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:01.929467 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9458e4c6-1c6d-4959-8395-299594659f84 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.202386 Jan 31 04:47:01.930017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 136/288] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:01 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:02.389439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2c4fa2fc-1f75-40b1-adcb-07bd68be0f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:02.390512 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2c4fa2fc-1f75-40b1-adcb-07bd68be0f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:02.399416 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2c4fa2fc-1f75-40b1-adcb-07bd68be0f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:02.400315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2c4fa2fc-1f75-40b1-adcb-07bd68be0f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:02.401122 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2c4fa2fc-1f75-40b1-adcb-07bd68be0f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:02.401562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2c4fa2fc-1f75-40b1-adcb-07bd68be0f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:02.531296 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2c4fa2fc-1f75-40b1-adcb-07bd68be0f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:02.555272 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2c4fa2fc-1f75-40b1-adcb-07bd68be0f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1269 microversion: 2.1 time: 0.168946 Jan 31 04:47:02.557484 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 153/289] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:02 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:02.947504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9d0d5762-aa90-47c2-bad9-bc1515d7527d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:02.948109 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9d0d5762-aa90-47c2-bad9-bc1515d7527d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:02.955794 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9d0d5762-aa90-47c2-bad9-bc1515d7527d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:02.959421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9d0d5762-aa90-47c2-bad9-bc1515d7527d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:02.959421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9d0d5762-aa90-47c2-bad9-bc1515d7527d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:02.959421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9d0d5762-aa90-47c2-bad9-bc1515d7527d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:03.210456 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9d0d5762-aa90-47c2-bad9-bc1515d7527d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:03.217755 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9d0d5762-aa90-47c2-bad9-bc1515d7527d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.273913 Jan 31 04:47:03.218576 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 137/290] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:02 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:03.577960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a0f64087-e3d7-486e-b6ec-0010d3318684 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:03.578733 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a0f64087-e3d7-486e-b6ec-0010d3318684 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:03.592296 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a0f64087-e3d7-486e-b6ec-0010d3318684 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:03.596824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a0f64087-e3d7-486e-b6ec-0010d3318684 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:03.596824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a0f64087-e3d7-486e-b6ec-0010d3318684 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:03.596824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a0f64087-e3d7-486e-b6ec-0010d3318684 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:03.718726 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a0f64087-e3d7-486e-b6ec-0010d3318684 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:03.730101 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a0f64087-e3d7-486e-b6ec-0010d3318684 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1275 microversion: 2.1 time: 0.160470 Jan 31 04:47:03.734909 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 154/291] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:03 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:04.236700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7d0c658d-b69a-4366-a533-5ed82e91986f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:04.237861 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7d0c658d-b69a-4366-a533-5ed82e91986f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:04.244039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7d0c658d-b69a-4366-a533-5ed82e91986f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:04.245574 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7d0c658d-b69a-4366-a533-5ed82e91986f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:04.245574 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7d0c658d-b69a-4366-a533-5ed82e91986f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:04.245950 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7d0c658d-b69a-4366-a533-5ed82e91986f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:04.762861 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-00735ff9-8569-4ef8-9f5b-f94f70e263cc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:04.763488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-00735ff9-8569-4ef8-9f5b-f94f70e263cc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:04.771792 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00735ff9-8569-4ef8-9f5b-f94f70e263cc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:04.772845 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00735ff9-8569-4ef8-9f5b-f94f70e263cc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:04.776345 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00735ff9-8569-4ef8-9f5b-f94f70e263cc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:04.776815 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00735ff9-8569-4ef8-9f5b-f94f70e263cc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:04.885011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7d0c658d-b69a-4366-a533-5ed82e91986f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:04.895352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7d0c658d-b69a-4366-a533-5ed82e91986f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.663156 Jan 31 04:47:04.897042 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 138/292] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:04 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:05.081090 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-00735ff9-8569-4ef8-9f5b-f94f70e263cc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:05.092054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-00735ff9-8569-4ef8-9f5b-f94f70e263cc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.332660 Jan 31 04:47:05.102837 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 155/293] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:04 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:05.320300 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-479dfd82-85c1-4be8-9536-1932eb9a0a96 req-8f9be719-141b-4206-9fbe-85605924650c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7823379c-200c-4cff-9ff8-c3ce4c2462cd", "tag": "dadcd049-61ea-4ff9-9b81-ff7ada3f3d65"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:05.324211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:47:05.324211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:47:05.333757 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-479dfd82-85c1-4be8-9536-1932eb9a0a96 req-8f9be719-141b-4206-9fbe-85605924650c service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:05.334192 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-479dfd82-85c1-4be8-9536-1932eb9a0a96 req-8f9be719-141b-4206-9fbe-85605924650c service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:05.347425 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-479dfd82-85c1-4be8-9536-1932eb9a0a96 req-8f9be719-141b-4206-9fbe-85605924650c service nova] Creating event network-changed:dadcd049-61ea-4ff9-9b81-ff7ada3f3d65 for instance 7823379c-200c-4cff-9ff8-c3ce4c2462cd on hv-cinder-82660 Jan 31 04:47:05.353075 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-479dfd82-85c1-4be8-9536-1932eb9a0a96 req-8f9be719-141b-4206-9fbe-85605924650c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036182 Jan 31 04:47:05.353851 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 139/294] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:05.915801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-11a90920-3e6f-4136-bd93-2544bfaabe46 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:05.917039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-11a90920-3e6f-4136-bd93-2544bfaabe46 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:05.933750 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-11a90920-3e6f-4136-bd93-2544bfaabe46 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:05.934995 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-11a90920-3e6f-4136-bd93-2544bfaabe46 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:05.936340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-11a90920-3e6f-4136-bd93-2544bfaabe46 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:05.936930 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-11a90920-3e6f-4136-bd93-2544bfaabe46 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:06.124726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7478921a-5c55-4aff-8c5b-cf0ec1623cc6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:06.125426 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7478921a-5c55-4aff-8c5b-cf0ec1623cc6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:06.143042 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7478921a-5c55-4aff-8c5b-cf0ec1623cc6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:06.143490 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7478921a-5c55-4aff-8c5b-cf0ec1623cc6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:06.147819 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7478921a-5c55-4aff-8c5b-cf0ec1623cc6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:06.147819 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7478921a-5c55-4aff-8c5b-cf0ec1623cc6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:06.306841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-11a90920-3e6f-4136-bd93-2544bfaabe46 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:06.328806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-11a90920-3e6f-4136-bd93-2544bfaabe46 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.417004 Jan 31 04:47:06.331121 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 156/295] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:05 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:06.510652 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7478921a-5c55-4aff-8c5b-cf0ec1623cc6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:06.529888 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7478921a-5c55-4aff-8c5b-cf0ec1623cc6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.411489 Jan 31 04:47:06.543682 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 140/296] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:06 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:07.347028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-742c0d3c-7060-4a63-87e9-c028660c8e15 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:07.347679 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-742c0d3c-7060-4a63-87e9-c028660c8e15 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:07.372960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-742c0d3c-7060-4a63-87e9-c028660c8e15 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:07.372960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-742c0d3c-7060-4a63-87e9-c028660c8e15 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:07.372960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-742c0d3c-7060-4a63-87e9-c028660c8e15 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:07.373221 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-742c0d3c-7060-4a63-87e9-c028660c8e15 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:07.552882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f13f45a0-bb4b-4135-a4b5-1dd7cb813c96 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:07.553503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f13f45a0-bb4b-4135-a4b5-1dd7cb813c96 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:07.562163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f13f45a0-bb4b-4135-a4b5-1dd7cb813c96 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:07.562616 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f13f45a0-bb4b-4135-a4b5-1dd7cb813c96 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:07.563435 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f13f45a0-bb4b-4135-a4b5-1dd7cb813c96 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:07.564106 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f13f45a0-bb4b-4135-a4b5-1dd7cb813c96 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:07.572068 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-742c0d3c-7060-4a63-87e9-c028660c8e15 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:07.595666 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-742c0d3c-7060-4a63-87e9-c028660c8e15 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.238787 Jan 31 04:47:07.603214 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 157/297] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:07 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:08.101777 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f13f45a0-bb4b-4135-a4b5-1dd7cb813c96 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:08.109542 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f13f45a0-bb4b-4135-a4b5-1dd7cb813c96 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.563736 Jan 31 04:47:08.110107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 141/298] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:07 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:08.618923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-fb63d143-0b4b-4446-8c0e-d845de0e81d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:08.619614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-fb63d143-0b4b-4446-8c0e-d845de0e81d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:08.626287 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fb63d143-0b4b-4446-8c0e-d845de0e81d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:08.626835 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fb63d143-0b4b-4446-8c0e-d845de0e81d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:08.627645 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fb63d143-0b4b-4446-8c0e-d845de0e81d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:08.628075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fb63d143-0b4b-4446-8c0e-d845de0e81d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:09.062869 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fb63d143-0b4b-4446-8c0e-d845de0e81d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:09.073574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-fb63d143-0b4b-4446-8c0e-d845de0e81d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.458339 Jan 31 04:47:09.074147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 158/299] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:08 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:09.127916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-00b2b809-da47-4491-9561-f77bf3e9359d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:09.128630 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-00b2b809-da47-4491-9561-f77bf3e9359d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:09.136132 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00b2b809-da47-4491-9561-f77bf3e9359d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:09.136817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00b2b809-da47-4491-9561-f77bf3e9359d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:09.137824 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00b2b809-da47-4491-9561-f77bf3e9359d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:09.138477 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00b2b809-da47-4491-9561-f77bf3e9359d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:09.302232 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-00b2b809-da47-4491-9561-f77bf3e9359d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:09.313103 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-00b2b809-da47-4491-9561-f77bf3e9359d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.189610 Jan 31 04:47:09.313907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 142/300] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:09 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:09.487528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f006e462-9623-44f1-8f64-cd6b842899cd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'create', calling method: .version_select at 0x7f69f72818b0>, body: {"keypair": {"name": "tempest-keypair-1444506426"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:09.505232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-f006e462-9623-44f1-8f64-cd6b842899cd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:47:09.509092 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-f006e462-9623-44f1-8f64-cd6b842899cd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for user e72e8f061290417f8b8a4bb8a0d9d2c1 and project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:47:09.658312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-f006e462-9623-44f1-8f64-cd6b842899cd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:47:09.662048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-f006e462-9623-44f1-8f64-cd6b842899cd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for user e72e8f061290417f8b8a4bb8a0d9d2c1 and project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:47:09.675321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f006e462-9623-44f1-8f64-cd6b842899cd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.303350 Jan 31 04:47:09.675918 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 159/301] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Jan 31 04:47:09 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:10.115926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-65dbbcfb-bfb3-4049-9320-0a2bf058ddc5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:10.115926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-65dbbcfb-bfb3-4049-9320-0a2bf058ddc5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:10.120015 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65dbbcfb-bfb3-4049-9320-0a2bf058ddc5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:10.120469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65dbbcfb-bfb3-4049-9320-0a2bf058ddc5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:10.121406 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65dbbcfb-bfb3-4049-9320-0a2bf058ddc5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:10.121848 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65dbbcfb-bfb3-4049-9320-0a2bf058ddc5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:10.331077 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8dac418f-1f1d-4b31-af6f-010f2c584569 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:10.332081 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8dac418f-1f1d-4b31-af6f-010f2c584569 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:10.342306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8dac418f-1f1d-4b31-af6f-010f2c584569 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:10.342596 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8dac418f-1f1d-4b31-af6f-010f2c584569 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:10.343451 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8dac418f-1f1d-4b31-af6f-010f2c584569 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:10.344034 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8dac418f-1f1d-4b31-af6f-010f2c584569 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:10.362015 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-65dbbcfb-bfb3-4049-9320-0a2bf058ddc5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:10.371582 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-65dbbcfb-bfb3-4049-9320-0a2bf058ddc5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.281005 Jan 31 04:47:10.372499 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 143/302] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:10 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:10.513882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8dac418f-1f1d-4b31-af6f-010f2c584569 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:10.523998 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8dac418f-1f1d-4b31-af6f-010f2c584569 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.197387 Jan 31 04:47:10.524928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 160/303] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:10 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:11.388464 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7e625376-1a43-4a59-868d-3aed29e32499 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:11.389700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7e625376-1a43-4a59-868d-3aed29e32499 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:11.396451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7e625376-1a43-4a59-868d-3aed29e32499 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:11.401669 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7e625376-1a43-4a59-868d-3aed29e32499 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:11.401669 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7e625376-1a43-4a59-868d-3aed29e32499 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:11.401669 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7e625376-1a43-4a59-868d-3aed29e32499 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:11.543527 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-811c1e96-0038-4246-a12f-a3376a683e77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:11.550377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-811c1e96-0038-4246-a12f-a3376a683e77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:11.572174 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-811c1e96-0038-4246-a12f-a3376a683e77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:11.572174 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-811c1e96-0038-4246-a12f-a3376a683e77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:11.573037 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-811c1e96-0038-4246-a12f-a3376a683e77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:11.573437 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-811c1e96-0038-4246-a12f-a3376a683e77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:11.624983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7e625376-1a43-4a59-868d-3aed29e32499 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:11.633866 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7e625376-1a43-4a59-868d-3aed29e32499 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.249128 Jan 31 04:47:11.635131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 144/304] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:11 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:11.817209 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-811c1e96-0038-4246-a12f-a3376a683e77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:11.827780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-811c1e96-0038-4246-a12f-a3376a683e77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.290769 Jan 31 04:47:11.830217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 161/305] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:11 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:12.558500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1128530369", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6d9d9c2-37a6-46fa-b349-eedfe966b621"}], "security_groups": [{"name": "tempest-securitygroup--337202983"}], "key_name": "tempest-keypair-1444506426", "user_data": "}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:12.650438 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-83ed43f8-fe47-48e7-8010-640d1612c9b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:12.651076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-83ed43f8-fe47-48e7-8010-640d1612c9b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:12.660779 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-83ed43f8-fe47-48e7-8010-640d1612c9b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:12.661218 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-83ed43f8-fe47-48e7-8010-640d1612c9b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:12.661998 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-83ed43f8-fe47-48e7-8010-640d1612c9b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:12.662427 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-83ed43f8-fe47-48e7-8010-640d1612c9b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:12.712945 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] validate_networks() for [('e6d9d9c2-37a6-46fa-b349-eedfe966b621', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:47:12.854593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-83ed43f8-fe47-48e7-8010-640d1612c9b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:12.863314 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-83ed43f8-fe47-48e7-8010-640d1612c9b9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.216529 Jan 31 04:47:12.873056 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 162/306] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:12 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:12.878078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3d3e8fca-ad5f-4e36-b163-18954c225979 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:12.878898 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3d3e8fca-ad5f-4e36-b163-18954c225979 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:12.886043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3d3e8fca-ad5f-4e36-b163-18954c225979 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:12.886494 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3d3e8fca-ad5f-4e36-b163-18954c225979 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:12.887315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3d3e8fca-ad5f-4e36-b163-18954c225979 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:12.887748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3d3e8fca-ad5f-4e36-b163-18954c225979 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:13.137211 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3d3e8fca-ad5f-4e36-b163-18954c225979 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:13.147308 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3d3e8fca-ad5f-4e36-b163-18954c225979 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.273021 Jan 31 04:47:13.148095 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 163/307] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:12 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:13.203562 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:47:13.204036 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:47:13.204598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:47:13.205012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:47:13.209583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:47:13.214119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:13.214571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:13.215416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:13.215854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:13.237929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:47:13.242163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for user e72e8f061290417f8b8a4bb8a0d9d2c1 and project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:47:13.256420 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:47:13.259092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:47:13.472572 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4d75140c-7752-4d0a-bb5f-4f7c15c7944e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.918741 Jan 31 04:47:13.473207 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 145/308] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:47:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:47:13.482986 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f9dc613e-82b5-4d23-9ef5-0dc9a559f944 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:13.483617 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f9dc613e-82b5-4d23-9ef5-0dc9a559f944 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:13.535170 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9dc613e-82b5-4d23-9ef5-0dc9a559f944 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:13.542051 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f9dc613e-82b5-4d23-9ef5-0dc9a559f944 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1238 microversion: 2.1 time: 0.062871 Jan 31 04:47:13.542617 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 164/309] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:13 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:13.881213 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-169c2e8f-f40b-4b8e-b0f9-55d2c07e330e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:13.882583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-169c2e8f-f40b-4b8e-b0f9-55d2c07e330e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:13.888541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-169c2e8f-f40b-4b8e-b0f9-55d2c07e330e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:13.888986 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-169c2e8f-f40b-4b8e-b0f9-55d2c07e330e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:13.889823 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-169c2e8f-f40b-4b8e-b0f9-55d2c07e330e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:13.890294 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-169c2e8f-f40b-4b8e-b0f9-55d2c07e330e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:14.058278 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-169c2e8f-f40b-4b8e-b0f9-55d2c07e330e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:14.067030 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-169c2e8f-f40b-4b8e-b0f9-55d2c07e330e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1520 microversion: 2.1 time: 0.190674 Jan 31 04:47:14.068915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 146/310] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:13 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:14.164070 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-949c1d66-c284-498f-b088-75ea20913ad1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:14.164668 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-949c1d66-c284-498f-b088-75ea20913ad1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:14.174877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-949c1d66-c284-498f-b088-75ea20913ad1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:14.176581 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-949c1d66-c284-498f-b088-75ea20913ad1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:14.177948 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-949c1d66-c284-498f-b088-75ea20913ad1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:14.184674 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-949c1d66-c284-498f-b088-75ea20913ad1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:14.343212 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-949c1d66-c284-498f-b088-75ea20913ad1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:14.350570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-949c1d66-c284-498f-b088-75ea20913ad1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.190125 Jan 31 04:47:14.351181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 165/311] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:14 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:14.559011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f25790af-8ad3-45de-b689-e880180b5d2c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:14.559789 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f25790af-8ad3-45de-b689-e880180b5d2c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:14.565653 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f25790af-8ad3-45de-b689-e880180b5d2c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:14.566116 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f25790af-8ad3-45de-b689-e880180b5d2c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:14.566883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f25790af-8ad3-45de-b689-e880180b5d2c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:14.570041 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f25790af-8ad3-45de-b689-e880180b5d2c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:14.629327 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f25790af-8ad3-45de-b689-e880180b5d2c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:14.636358 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f25790af-8ad3-45de-b689-e880180b5d2c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1242 microversion: 2.1 time: 0.080941 Jan 31 04:47:14.636904 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 147/312] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:14 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:15.085277 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-29099199-f112-4a61-9df1-3282447cd670 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:15.087465 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-29099199-f112-4a61-9df1-3282447cd670 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:15.104292 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-29099199-f112-4a61-9df1-3282447cd670 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:15.110501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-29099199-f112-4a61-9df1-3282447cd670 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:15.110501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-29099199-f112-4a61-9df1-3282447cd670 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:15.110501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-29099199-f112-4a61-9df1-3282447cd670 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:15.242367 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-29099199-f112-4a61-9df1-3282447cd670 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:15.249690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-29099199-f112-4a61-9df1-3282447cd670 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1500 microversion: 2.1 time: 0.168064 Jan 31 04:47:15.250243 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 166/313] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:15 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:15.265699 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8a966dd0-b036-4686-8a88-ffa7ee0c5ba0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:15.266347 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8a966dd0-b036-4686-8a88-ffa7ee0c5ba0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:15.273394 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a966dd0-b036-4686-8a88-ffa7ee0c5ba0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:15.273846 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a966dd0-b036-4686-8a88-ffa7ee0c5ba0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:15.274617 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a966dd0-b036-4686-8a88-ffa7ee0c5ba0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:15.275090 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a966dd0-b036-4686-8a88-ffa7ee0c5ba0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:15.373421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6b5875c1-2231-4e60-bebe-35f06c14cb40 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:15.377048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6b5875c1-2231-4e60-bebe-35f06c14cb40 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:15.382573 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6b5875c1-2231-4e60-bebe-35f06c14cb40 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:15.383251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6b5875c1-2231-4e60-bebe-35f06c14cb40 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:15.385232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6b5875c1-2231-4e60-bebe-35f06c14cb40 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:15.385864 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6b5875c1-2231-4e60-bebe-35f06c14cb40 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:15.416069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8a966dd0-b036-4686-8a88-ffa7ee0c5ba0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:15.424872 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8a966dd0-b036-4686-8a88-ffa7ee0c5ba0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1515 microversion: 2.1 time: 0.162802 Jan 31 04:47:15.425543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 148/314] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:15 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:15.531423 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6b5875c1-2231-4e60-bebe-35f06c14cb40 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:15.539244 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6b5875c1-2231-4e60-bebe-35f06c14cb40 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.175111 Jan 31 04:47:15.549324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 167/315] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:15 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:15.652746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9a4931a6-0c71-41e9-8328-7449daf64292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:15.653304 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9a4931a6-0c71-41e9-8328-7449daf64292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:15.659198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a4931a6-0c71-41e9-8328-7449daf64292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:15.659646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a4931a6-0c71-41e9-8328-7449daf64292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:15.660916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a4931a6-0c71-41e9-8328-7449daf64292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:15.660916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a4931a6-0c71-41e9-8328-7449daf64292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:15.720405 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9a4931a6-0c71-41e9-8328-7449daf64292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:15.727821 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9a4931a6-0c71-41e9-8328-7449daf64292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1290 microversion: 2.1 time: 0.078784 Jan 31 04:47:15.728375 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 149/316] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:15 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1290 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:16.557098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e2244956-866a-4ede-a8d9-ae02c36f66fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:16.557786 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e2244956-866a-4ede-a8d9-ae02c36f66fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:16.564979 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e2244956-866a-4ede-a8d9-ae02c36f66fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:16.565523 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e2244956-866a-4ede-a8d9-ae02c36f66fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:16.566381 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e2244956-866a-4ede-a8d9-ae02c36f66fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:16.567066 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e2244956-866a-4ede-a8d9-ae02c36f66fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:16.744026 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e2244956-866a-4ede-a8d9-ae02c36f66fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:16.744672 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7ea36f4e-729c-43ea-a5ae-1a9d5ae18716 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:16.745540 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7ea36f4e-729c-43ea-a5ae-1a9d5ae18716 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:16.752940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e2244956-866a-4ede-a8d9-ae02c36f66fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.199858 Jan 31 04:47:16.761320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 168/317] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:16 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:16.761502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ea36f4e-729c-43ea-a5ae-1a9d5ae18716 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:16.761502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ea36f4e-729c-43ea-a5ae-1a9d5ae18716 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:16.761502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ea36f4e-729c-43ea-a5ae-1a9d5ae18716 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:16.761502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ea36f4e-729c-43ea-a5ae-1a9d5ae18716 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:16.905726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7ea36f4e-729c-43ea-a5ae-1a9d5ae18716 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:16.913753 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7ea36f4e-729c-43ea-a5ae-1a9d5ae18716 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.173231 Jan 31 04:47:16.914309 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 150/318] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:16 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:17.345962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-db7e8a1e-c009-4ac3-9ebc-dff1721ac58c req-2a7c7b16-6230-4ac7-8917-6f643eabe8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7823379c-200c-4cff-9ff8-c3ce4c2462cd", "name": "network-vif-plugged", "status": "completed", "tag": "dadcd049-61ea-4ff9-9b81-ff7ada3f3d65"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:17.347946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:47:17.347946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:47:17.356608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-db7e8a1e-c009-4ac3-9ebc-dff1721ac58c req-2a7c7b16-6230-4ac7-8917-6f643eabe8d6 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:17.357046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-db7e8a1e-c009-4ac3-9ebc-dff1721ac58c req-2a7c7b16-6230-4ac7-8917-6f643eabe8d6 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:17.368615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-db7e8a1e-c009-4ac3-9ebc-dff1721ac58c req-2a7c7b16-6230-4ac7-8917-6f643eabe8d6 service nova] Creating event network-vif-plugged:dadcd049-61ea-4ff9-9b81-ff7ada3f3d65 for instance 7823379c-200c-4cff-9ff8-c3ce4c2462cd on hv-cinder-82660 Jan 31 04:47:17.373563 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-db7e8a1e-c009-4ac3-9ebc-dff1721ac58c req-2a7c7b16-6230-4ac7-8917-6f643eabe8d6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032080 Jan 31 04:47:17.374344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 169/319] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:47:17.769937 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0d909039-11c1-4d35-ba7d-1adfc707c6cd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:17.770553 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0d909039-11c1-4d35-ba7d-1adfc707c6cd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:17.777013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0d909039-11c1-4d35-ba7d-1adfc707c6cd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:17.777477 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0d909039-11c1-4d35-ba7d-1adfc707c6cd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:17.778303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0d909039-11c1-4d35-ba7d-1adfc707c6cd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:17.778773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0d909039-11c1-4d35-ba7d-1adfc707c6cd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:17.878732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-660b6a97-21cf-413c-9854-c0b56dd1897b req-d35f3d0f-0b68-44f9-916d-60c6899ba993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b864423-6740-4f17-848e-ab7213f4ceab", "tag": "f8fdd1ca-9af9-4dbb-9ecf-1f7188a736a6"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:17.880580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:47:17.880580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:47:17.889019 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-660b6a97-21cf-413c-9854-c0b56dd1897b req-d35f3d0f-0b68-44f9-916d-60c6899ba993 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:17.889473 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-660b6a97-21cf-413c-9854-c0b56dd1897b req-d35f3d0f-0b68-44f9-916d-60c6899ba993 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:17.905335 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-660b6a97-21cf-413c-9854-c0b56dd1897b req-d35f3d0f-0b68-44f9-916d-60c6899ba993 service nova] Creating event network-changed:f8fdd1ca-9af9-4dbb-9ecf-1f7188a736a6 for instance 2b864423-6740-4f17-848e-ab7213f4ceab on hv-cinder-82660 Jan 31 04:47:17.910278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-660b6a97-21cf-413c-9854-c0b56dd1897b req-d35f3d0f-0b68-44f9-916d-60c6899ba993 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037178 Jan 31 04:47:17.910905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 170/320] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:47:17.931858 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1140b647-aada-428a-82cf-78f00ee27239 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:17.932492 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1140b647-aada-428a-82cf-78f00ee27239 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:17.934112 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0d909039-11c1-4d35-ba7d-1adfc707c6cd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:17.939627 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1140b647-aada-428a-82cf-78f00ee27239 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:17.940063 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1140b647-aada-428a-82cf-78f00ee27239 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:17.940847 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1140b647-aada-428a-82cf-78f00ee27239 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:17.941426 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1140b647-aada-428a-82cf-78f00ee27239 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:17.942539 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0d909039-11c1-4d35-ba7d-1adfc707c6cd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.176979 Jan 31 04:47:17.949424 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 151/321] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:17 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:18.075675 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1140b647-aada-428a-82cf-78f00ee27239 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:18.091216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1140b647-aada-428a-82cf-78f00ee27239 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.163517 Jan 31 04:47:18.092251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 171/322] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:17 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:18.959364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bdfd0340-32e0-4e2a-abe5-9e878a15f575 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:18.960011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bdfd0340-32e0-4e2a-abe5-9e878a15f575 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:18.966157 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bdfd0340-32e0-4e2a-abe5-9e878a15f575 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:18.966601 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bdfd0340-32e0-4e2a-abe5-9e878a15f575 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:18.967407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bdfd0340-32e0-4e2a-abe5-9e878a15f575 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:18.967835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bdfd0340-32e0-4e2a-abe5-9e878a15f575 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:19.097505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-bdfd0340-32e0-4e2a-abe5-9e878a15f575 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:19.104762 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bdfd0340-32e0-4e2a-abe5-9e878a15f575 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.149019 Jan 31 04:47:19.105311 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 152/323] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:18 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:19.108216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f22c8a53-86da-4ec4-997b-18d9f3b211dd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:19.108819 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f22c8a53-86da-4ec4-997b-18d9f3b211dd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:19.116127 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f22c8a53-86da-4ec4-997b-18d9f3b211dd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:19.116568 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f22c8a53-86da-4ec4-997b-18d9f3b211dd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:19.117344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f22c8a53-86da-4ec4-997b-18d9f3b211dd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:19.117771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f22c8a53-86da-4ec4-997b-18d9f3b211dd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:19.248398 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f22c8a53-86da-4ec4-997b-18d9f3b211dd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:19.256363 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f22c8a53-86da-4ec4-997b-18d9f3b211dd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.151886 Jan 31 04:47:19.256938 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 172/324] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:19 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:20.121155 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6943ab48-ae90-4aa8-9a2d-082951b7d4e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:20.121769 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6943ab48-ae90-4aa8-9a2d-082951b7d4e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:20.129151 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6943ab48-ae90-4aa8-9a2d-082951b7d4e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:20.129606 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6943ab48-ae90-4aa8-9a2d-082951b7d4e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:20.130377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6943ab48-ae90-4aa8-9a2d-082951b7d4e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:20.130832 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6943ab48-ae90-4aa8-9a2d-082951b7d4e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:20.262277 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6943ab48-ae90-4aa8-9a2d-082951b7d4e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:20.269723 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6943ab48-ae90-4aa8-9a2d-082951b7d4e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.152183 Jan 31 04:47:20.276025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 153/325] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:20 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:20.276131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9a2aac5e-557f-4c47-a534-52e64ef5fc3d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:20.276131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9a2aac5e-557f-4c47-a534-52e64ef5fc3d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:20.279797 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9a2aac5e-557f-4c47-a534-52e64ef5fc3d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:20.280238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9a2aac5e-557f-4c47-a534-52e64ef5fc3d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:20.280993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9a2aac5e-557f-4c47-a534-52e64ef5fc3d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:20.281419 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9a2aac5e-557f-4c47-a534-52e64ef5fc3d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:20.415317 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9a2aac5e-557f-4c47-a534-52e64ef5fc3d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:20.423018 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9a2aac5e-557f-4c47-a534-52e64ef5fc3d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.153244 Jan 31 04:47:20.423859 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 173/326] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:20 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:21.290845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b3dcdd8d-e09a-4ad0-a2f5-7b8c8adb842f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:21.291500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b3dcdd8d-e09a-4ad0-a2f5-7b8c8adb842f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:21.298073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3dcdd8d-e09a-4ad0-a2f5-7b8c8adb842f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:21.298598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3dcdd8d-e09a-4ad0-a2f5-7b8c8adb842f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:21.299461 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3dcdd8d-e09a-4ad0-a2f5-7b8c8adb842f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:21.299897 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3dcdd8d-e09a-4ad0-a2f5-7b8c8adb842f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:21.440601 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b3dcdd8d-e09a-4ad0-a2f5-7b8c8adb842f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:21.440949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-71998354-fc80-4d99-9cef-796b64f73a9c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:21.441555 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-71998354-fc80-4d99-9cef-796b64f73a9c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:21.447898 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b3dcdd8d-e09a-4ad0-a2f5-7b8c8adb842f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.160676 Jan 31 04:47:21.448059 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-71998354-fc80-4d99-9cef-796b64f73a9c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:21.448370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-71998354-fc80-4d99-9cef-796b64f73a9c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:21.448472 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 154/327] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:21 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:21.449149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-71998354-fc80-4d99-9cef-796b64f73a9c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:21.449751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-71998354-fc80-4d99-9cef-796b64f73a9c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:21.584574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-71998354-fc80-4d99-9cef-796b64f73a9c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:21.591661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-71998354-fc80-4d99-9cef-796b64f73a9c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.155530 Jan 31 04:47:21.592279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 174/328] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:21 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:22.465099 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c03c2e13-ad4d-4a19-9c40-2b07fac10a76 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:22.465702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c03c2e13-ad4d-4a19-9c40-2b07fac10a76 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:22.473120 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c03c2e13-ad4d-4a19-9c40-2b07fac10a76 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:22.473569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c03c2e13-ad4d-4a19-9c40-2b07fac10a76 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:22.474331 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c03c2e13-ad4d-4a19-9c40-2b07fac10a76 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:22.474758 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c03c2e13-ad4d-4a19-9c40-2b07fac10a76 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:22.603755 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c03c2e13-ad4d-4a19-9c40-2b07fac10a76 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:22.609272 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-fba499ca-0ab2-4aac-98a8-893d57c4db1d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:22.610396 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-fba499ca-0ab2-4aac-98a8-893d57c4db1d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:22.611428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c03c2e13-ad4d-4a19-9c40-2b07fac10a76 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.149893 Jan 31 04:47:22.611996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 155/329] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:22 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:22.617641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fba499ca-0ab2-4aac-98a8-893d57c4db1d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:22.618266 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fba499ca-0ab2-4aac-98a8-893d57c4db1d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:22.619069 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fba499ca-0ab2-4aac-98a8-893d57c4db1d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:22.619498 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fba499ca-0ab2-4aac-98a8-893d57c4db1d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:22.751775 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fba499ca-0ab2-4aac-98a8-893d57c4db1d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:22.759108 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-fba499ca-0ab2-4aac-98a8-893d57c4db1d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.154429 Jan 31 04:47:22.759657 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 175/330] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:22 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:23.627960 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d8417e4b-72f4-4ffb-89da-81f62d8d0e81 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:23.628822 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d8417e4b-72f4-4ffb-89da-81f62d8d0e81 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:23.635389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8417e4b-72f4-4ffb-89da-81f62d8d0e81 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:23.636181 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8417e4b-72f4-4ffb-89da-81f62d8d0e81 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:23.637037 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8417e4b-72f4-4ffb-89da-81f62d8d0e81 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:23.637501 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8417e4b-72f4-4ffb-89da-81f62d8d0e81 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:23.775923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ceb096cb-4c0a-45f0-8997-e388913129b8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:23.776467 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ceb096cb-4c0a-45f0-8997-e388913129b8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:23.783149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ceb096cb-4c0a-45f0-8997-e388913129b8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:23.783590 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ceb096cb-4c0a-45f0-8997-e388913129b8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:23.784363 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ceb096cb-4c0a-45f0-8997-e388913129b8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:23.784788 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ceb096cb-4c0a-45f0-8997-e388913129b8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:23.786778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d8417e4b-72f4-4ffb-89da-81f62d8d0e81 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:23.794003 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d8417e4b-72f4-4ffb-89da-81f62d8d0e81 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.170172 Jan 31 04:47:23.794561 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 156/331] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:23 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:23.917216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ceb096cb-4c0a-45f0-8997-e388913129b8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:23.924756 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ceb096cb-4c0a-45f0-8997-e388913129b8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.152606 Jan 31 04:47:23.925322 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 176/332] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:23 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:24.558029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-13d487a8-9398-4783-938a-0f42fe602e9d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:24.559057 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-13d487a8-9398-4783-938a-0f42fe602e9d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:24.565798 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-13d487a8-9398-4783-938a-0f42fe602e9d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:24.566249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-13d487a8-9398-4783-938a-0f42fe602e9d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:24.567067 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-13d487a8-9398-4783-938a-0f42fe602e9d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:24.567506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-13d487a8-9398-4783-938a-0f42fe602e9d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:24.590418 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-13d487a8-9398-4783-938a-0f42fe602e9d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lazy-loading 'flavor' on Instance uuid 81eea382-424b-4435-9241-e428592c98f3 {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:47:24.811321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-971e5fea-ac6a-4315-9fff-bf7d7b8414ac tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:24.812526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-971e5fea-ac6a-4315-9fff-bf7d7b8414ac tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:24.819869 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-971e5fea-ac6a-4315-9fff-bf7d7b8414ac tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:24.821562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-971e5fea-ac6a-4315-9fff-bf7d7b8414ac tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:24.821562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-971e5fea-ac6a-4315-9fff-bf7d7b8414ac tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:24.821562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-971e5fea-ac6a-4315-9fff-bf7d7b8414ac tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:24.903718 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-13d487a8-9398-4783-938a-0f42fe602e9d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/action" status: 200 len: 32 microversion: 2.1 time: 0.348866 Jan 31 04:47:24.908602 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 157/333] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:47:24 2022] POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/action => generated 32 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 04:47:24.913625 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f3dcc25d-f838-4bee-b221-82d93fb0c7e8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:24.914315 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f3dcc25d-f838-4bee-b221-82d93fb0c7e8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:24.921183 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f3dcc25d-f838-4bee-b221-82d93fb0c7e8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:24.921895 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f3dcc25d-f838-4bee-b221-82d93fb0c7e8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:24.923873 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f3dcc25d-f838-4bee-b221-82d93fb0c7e8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:24.924324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f3dcc25d-f838-4bee-b221-82d93fb0c7e8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:24.958582 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-971e5fea-ac6a-4315-9fff-bf7d7b8414ac tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:24.966141 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-971e5fea-ac6a-4315-9fff-bf7d7b8414ac tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.158458 Jan 31 04:47:24.966703 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 177/334] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:24 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:24.970936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c13cf546-40b6-4677-a6c1-1db96bc3177c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:24.971623 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c13cf546-40b6-4677-a6c1-1db96bc3177c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:24.977421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c13cf546-40b6-4677-a6c1-1db96bc3177c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:24.977870 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c13cf546-40b6-4677-a6c1-1db96bc3177c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:24.978640 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c13cf546-40b6-4677-a6c1-1db96bc3177c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:24.979446 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c13cf546-40b6-4677-a6c1-1db96bc3177c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:25.074490 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f3dcc25d-f838-4bee-b221-82d93fb0c7e8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:25.082538 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f3dcc25d-f838-4bee-b221-82d93fb0c7e8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.172720 Jan 31 04:47:25.083335 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 158/335] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:24 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:25.117981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c13cf546-40b6-4677-a6c1-1db96bc3177c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:25.125615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c13cf546-40b6-4677-a6c1-1db96bc3177c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.157926 Jan 31 04:47:25.126347 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 178/336] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:24 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:25.982699 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-043aada8-6e3e-4a1e-bca4-e48f6f7d42e0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:25.983324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-043aada8-6e3e-4a1e-bca4-e48f6f7d42e0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:25.989480 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-043aada8-6e3e-4a1e-bca4-e48f6f7d42e0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:25.989921 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-043aada8-6e3e-4a1e-bca4-e48f6f7d42e0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:25.990677 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-043aada8-6e3e-4a1e-bca4-e48f6f7d42e0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:25.991130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-043aada8-6e3e-4a1e-bca4-e48f6f7d42e0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:26.099428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f19c50dc-217d-43df-bc45-8a28e4021a24 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:26.100159 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f19c50dc-217d-43df-bc45-8a28e4021a24 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:26.106402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f19c50dc-217d-43df-bc45-8a28e4021a24 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:26.106989 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f19c50dc-217d-43df-bc45-8a28e4021a24 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:26.108119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f19c50dc-217d-43df-bc45-8a28e4021a24 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:26.108664 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f19c50dc-217d-43df-bc45-8a28e4021a24 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:26.121243 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-043aada8-6e3e-4a1e-bca4-e48f6f7d42e0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:26.129444 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-043aada8-6e3e-4a1e-bca4-e48f6f7d42e0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.150058 Jan 31 04:47:26.129999 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 159/337] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:25 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:26.141971 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d78becc7-7be5-4bec-974d-0d667f4ad5ed tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:26.142568 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d78becc7-7be5-4bec-974d-0d667f4ad5ed tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:26.148356 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d78becc7-7be5-4bec-974d-0d667f4ad5ed tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:26.148794 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d78becc7-7be5-4bec-974d-0d667f4ad5ed tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:26.149567 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d78becc7-7be5-4bec-974d-0d667f4ad5ed tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:26.149996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d78becc7-7be5-4bec-974d-0d667f4ad5ed tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:26.245607 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f19c50dc-217d-43df-bc45-8a28e4021a24 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:26.253561 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f19c50dc-217d-43df-bc45-8a28e4021a24 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.157736 Jan 31 04:47:26.254463 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 179/338] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:26 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:26.285758 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d78becc7-7be5-4bec-974d-0d667f4ad5ed tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:26.292874 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d78becc7-7be5-4bec-974d-0d667f4ad5ed tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.154375 Jan 31 04:47:26.293430 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 160/339] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:26 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:27.146278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-041e5c46-f6ca-4a06-ac14-47e1a4f37f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:27.146903 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-041e5c46-f6ca-4a06-ac14-47e1a4f37f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:27.153081 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-041e5c46-f6ca-4a06-ac14-47e1a4f37f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:27.153518 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-041e5c46-f6ca-4a06-ac14-47e1a4f37f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:27.154272 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-041e5c46-f6ca-4a06-ac14-47e1a4f37f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:27.154695 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-041e5c46-f6ca-4a06-ac14-47e1a4f37f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:27.270976 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9505bda5-7434-4c2b-9993-8897f388a0a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:27.271668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9505bda5-7434-4c2b-9993-8897f388a0a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:27.278001 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9505bda5-7434-4c2b-9993-8897f388a0a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:27.278455 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9505bda5-7434-4c2b-9993-8897f388a0a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:27.279361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9505bda5-7434-4c2b-9993-8897f388a0a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:27.279796 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9505bda5-7434-4c2b-9993-8897f388a0a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:27.283261 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-041e5c46-f6ca-4a06-ac14-47e1a4f37f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:27.290468 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-041e5c46-f6ca-4a06-ac14-47e1a4f37f17 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.147722 Jan 31 04:47:27.291054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 180/340] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:27 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:27.308995 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-481256fb-1bf0-422e-bde6-394f19a50c55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:27.309609 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-481256fb-1bf0-422e-bde6-394f19a50c55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:27.316351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-481256fb-1bf0-422e-bde6-394f19a50c55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:27.316873 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-481256fb-1bf0-422e-bde6-394f19a50c55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:27.317716 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-481256fb-1bf0-422e-bde6-394f19a50c55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:27.318215 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-481256fb-1bf0-422e-bde6-394f19a50c55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:27.412812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9505bda5-7434-4c2b-9993-8897f388a0a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:27.420220 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9505bda5-7434-4c2b-9993-8897f388a0a4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.152882 Jan 31 04:47:27.420784 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 161/341] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:27 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:27.452626 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-481256fb-1bf0-422e-bde6-394f19a50c55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:27.459930 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-481256fb-1bf0-422e-bde6-394f19a50c55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.154541 Jan 31 04:47:27.460487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 181/342] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:27 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:28.307340 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-dd0bc562-41d2-4ba6-acbc-1ff4abba0601 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:28.307939 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-dd0bc562-41d2-4ba6-acbc-1ff4abba0601 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:28.315596 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dd0bc562-41d2-4ba6-acbc-1ff4abba0601 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:28.316063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dd0bc562-41d2-4ba6-acbc-1ff4abba0601 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:28.316821 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dd0bc562-41d2-4ba6-acbc-1ff4abba0601 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:28.317245 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dd0bc562-41d2-4ba6-acbc-1ff4abba0601 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:28.436612 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6093abde-a223-4615-b664-094e63bda110 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:28.437207 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6093abde-a223-4615-b664-094e63bda110 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:28.444297 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6093abde-a223-4615-b664-094e63bda110 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:28.444738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6093abde-a223-4615-b664-094e63bda110 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:28.445505 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6093abde-a223-4615-b664-094e63bda110 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:28.445933 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6093abde-a223-4615-b664-094e63bda110 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:28.453363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-dd0bc562-41d2-4ba6-acbc-1ff4abba0601 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:28.460904 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-dd0bc562-41d2-4ba6-acbc-1ff4abba0601 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.157392 Jan 31 04:47:28.463777 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 162/343] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:28 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:28.477028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a8b060ba-c319-406b-ae9a-4af4a809e8d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:28.477826 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a8b060ba-c319-406b-ae9a-4af4a809e8d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:28.483650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a8b060ba-c319-406b-ae9a-4af4a809e8d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:28.484163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a8b060ba-c319-406b-ae9a-4af4a809e8d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:28.485663 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a8b060ba-c319-406b-ae9a-4af4a809e8d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:28.486190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a8b060ba-c319-406b-ae9a-4af4a809e8d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:28.621841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6093abde-a223-4615-b664-094e63bda110 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:28.631214 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6093abde-a223-4615-b664-094e63bda110 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.198045 Jan 31 04:47:28.631787 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 182/344] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:28 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:28.638936 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a8b060ba-c319-406b-ae9a-4af4a809e8d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:28.646955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a8b060ba-c319-406b-ae9a-4af4a809e8d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.173232 Jan 31 04:47:28.647639 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 163/345] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:28 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:29.477822 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-06dc08ef-9b03-4f8e-b1e5-b5a09533f0b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:29.478346 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-06dc08ef-9b03-4f8e-b1e5-b5a09533f0b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:29.484200 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-06dc08ef-9b03-4f8e-b1e5-b5a09533f0b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:29.484646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-06dc08ef-9b03-4f8e-b1e5-b5a09533f0b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:29.485609 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-06dc08ef-9b03-4f8e-b1e5-b5a09533f0b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:29.486038 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-06dc08ef-9b03-4f8e-b1e5-b5a09533f0b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:29.617872 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-06dc08ef-9b03-4f8e-b1e5-b5a09533f0b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:29.624945 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-06dc08ef-9b03-4f8e-b1e5-b5a09533f0b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1317 microversion: 2.1 time: 0.150854 Jan 31 04:47:29.643462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 183/346] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:29 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:29.648053 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-66064220-e408-4878-9fc5-1a33dbb1558d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:29.648657 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-66064220-e408-4878-9fc5-1a33dbb1558d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:29.655063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66064220-e408-4878-9fc5-1a33dbb1558d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:29.655610 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66064220-e408-4878-9fc5-1a33dbb1558d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:29.656382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66064220-e408-4878-9fc5-1a33dbb1558d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:29.656940 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66064220-e408-4878-9fc5-1a33dbb1558d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:29.666219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b474a17b-1ee2-4d71-b31c-846f556b6c5d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:29.666931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b474a17b-1ee2-4d71-b31c-846f556b6c5d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:29.678487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b474a17b-1ee2-4d71-b31c-846f556b6c5d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:29.679626 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b474a17b-1ee2-4d71-b31c-846f556b6c5d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:29.680524 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b474a17b-1ee2-4d71-b31c-846f556b6c5d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:29.681537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b474a17b-1ee2-4d71-b31c-846f556b6c5d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:29.801364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-66064220-e408-4878-9fc5-1a33dbb1558d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:29.809013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-66064220-e408-4878-9fc5-1a33dbb1558d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.164513 Jan 31 04:47:29.809948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 164/347] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:29 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:29.832012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b474a17b-1ee2-4d71-b31c-846f556b6c5d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:29.839291 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b474a17b-1ee2-4d71-b31c-846f556b6c5d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.176679 Jan 31 04:47:29.839843 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 184/348] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:29 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:30.657882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2ba688d3-64c4-4b7b-a083-d62c9d8691ef tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:30.658541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2ba688d3-64c4-4b7b-a083-d62c9d8691ef tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:30.665939 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2ba688d3-64c4-4b7b-a083-d62c9d8691ef tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:30.665939 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2ba688d3-64c4-4b7b-a083-d62c9d8691ef tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:30.666643 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2ba688d3-64c4-4b7b-a083-d62c9d8691ef tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:30.667196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2ba688d3-64c4-4b7b-a083-d62c9d8691ef tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:30.805929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2ba688d3-64c4-4b7b-a083-d62c9d8691ef tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:30.813303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2ba688d3-64c4-4b7b-a083-d62c9d8691ef tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1508 microversion: 2.1 time: 0.159834 Jan 31 04:47:30.813989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 165/349] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:30 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:30.826518 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-681d7f7e-579c-4e55-b076-488302000cb4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:30.827098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-681d7f7e-579c-4e55-b076-488302000cb4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:30.830172 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ea1a7f6-be9f-45f4-bf3e-e5abca5a406f"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:30.831333 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:30.834389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-681d7f7e-579c-4e55-b076-488302000cb4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:30.834852 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-681d7f7e-579c-4e55-b076-488302000cb4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:30.835647 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-681d7f7e-579c-4e55-b076-488302000cb4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:30.836083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-681d7f7e-579c-4e55-b076-488302000cb4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:30.837376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:30.837821 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:30.838686 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:30.839217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:30.975220 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-681d7f7e-579c-4e55-b076-488302000cb4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:30.982517 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-681d7f7e-579c-4e55-b076-488302000cb4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.159642 Jan 31 04:47:30.983108 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 185/350] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:30 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:30.987474 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-53a99213-8ed4-40f1-a27d-e4ce3726acde tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:30.988070 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-53a99213-8ed4-40f1-a27d-e4ce3726acde tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:30.993960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-53a99213-8ed4-40f1-a27d-e4ce3726acde tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:30.994412 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-53a99213-8ed4-40f1-a27d-e4ce3726acde tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:30.995215 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-53a99213-8ed4-40f1-a27d-e4ce3726acde tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:30.995649 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-53a99213-8ed4-40f1-a27d-e4ce3726acde tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:31.129814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-53a99213-8ed4-40f1-a27d-e4ce3726acde tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:31.137498 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-53a99213-8ed4-40f1-a27d-e4ce3726acde tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.153469 Jan 31 04:47:31.138058 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 186/351] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:30 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:31.277996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] HTTP exception thrown: Invalid volume: volume 7ea1a7f6-be9f-45f4-bf3e-e5abca5a406f is already attached to instances: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf Jan 31 04:47:31.278597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Returning 400 to user: Invalid volume: volume 7ea1a7f6-be9f-45f4-bf3e-e5abca5a406f is already attached to instances: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:47:31.279444 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8a2ca605-884e-4d33-96da-8c64571b213c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.453800 Jan 31 04:47:31.280973 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 166/352] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:47:30 2022] POST /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd/os-volume_attachments => generated 174 bytes in 456 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 31 04:47:31.375185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6c09e365-57de-4894-a9bd-518522872c2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:31.375185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6c09e365-57de-4894-a9bd-518522872c2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:31.381445 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c09e365-57de-4894-a9bd-518522872c2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:31.381884 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c09e365-57de-4894-a9bd-518522872c2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:31.382834 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c09e365-57de-4894-a9bd-518522872c2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:31.383419 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c09e365-57de-4894-a9bd-518522872c2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:31.504671 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-6c09e365-57de-4894-a9bd-518522872c2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lazy-loading 'services' on Instance uuid dd9c56db-f2a0-485f-83e4-bc1b8b9172cf {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:47:31.756337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6c09e365-57de-4894-a9bd-518522872c2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "DELETE /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments/7ea1a7f6-be9f-45f4-bf3e-e5abca5a406f" status: 202 len: 0 microversion: 2.1 time: 0.387582 Jan 31 04:47:31.756337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 187/353] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:47:31 2022] DELETE /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments/7ea1a7f6-be9f-45f4-bf3e-e5abca5a406f => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:47:31.764171 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d8850a16-c340-40e8-ad67-8aa75c0ee987 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:31.765131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d8850a16-c340-40e8-ad67-8aa75c0ee987 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:31.772354 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8850a16-c340-40e8-ad67-8aa75c0ee987 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:31.773022 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8850a16-c340-40e8-ad67-8aa75c0ee987 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:31.773890 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8850a16-c340-40e8-ad67-8aa75c0ee987 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:31.774319 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8850a16-c340-40e8-ad67-8aa75c0ee987 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:31.804322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d8850a16-c340-40e8-ad67-8aa75c0ee987 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Jan 31 04:47:31.805864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 167/354] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:31 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:32.000979 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f1a0b326-b827-40c2-8388-1ae7e2eee9a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:32.001749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f1a0b326-b827-40c2-8388-1ae7e2eee9a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:32.008528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f1a0b326-b827-40c2-8388-1ae7e2eee9a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:32.008976 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f1a0b326-b827-40c2-8388-1ae7e2eee9a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:32.009741 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f1a0b326-b827-40c2-8388-1ae7e2eee9a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:32.010174 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f1a0b326-b827-40c2-8388-1ae7e2eee9a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:32.144089 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f1a0b326-b827-40c2-8388-1ae7e2eee9a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:32.151472 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f1a0b326-b827-40c2-8388-1ae7e2eee9a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.154567 Jan 31 04:47:32.152052 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 188/355] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:31 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:32.154040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0aa01106-102a-4821-a642-39346ad4b0ae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:32.154641 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0aa01106-102a-4821-a642-39346ad4b0ae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:32.161068 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0aa01106-102a-4821-a642-39346ad4b0ae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:32.161580 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0aa01106-102a-4821-a642-39346ad4b0ae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:32.162528 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0aa01106-102a-4821-a642-39346ad4b0ae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:32.163019 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0aa01106-102a-4821-a642-39346ad4b0ae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:32.288974 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0aa01106-102a-4821-a642-39346ad4b0ae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:32.296073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0aa01106-102a-4821-a642-39346ad4b0ae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.145555 Jan 31 04:47:32.296662 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 168/356] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:32 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:32.816345 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-acd21336-cea1-4037-ae95-f5ff87ca748e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:32.817315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-acd21336-cea1-4037-ae95-f5ff87ca748e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:32.823015 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-acd21336-cea1-4037-ae95-f5ff87ca748e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:32.823461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-acd21336-cea1-4037-ae95-f5ff87ca748e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:32.824227 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-acd21336-cea1-4037-ae95-f5ff87ca748e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:32.824652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-acd21336-cea1-4037-ae95-f5ff87ca748e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:32.854581 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-acd21336-cea1-4037-ae95-f5ff87ca748e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Jan 31 04:47:32.855152 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 189/357] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:32 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:33.168593 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d647afff-2072-4d6c-92f8-753004422822 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:33.169262 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d647afff-2072-4d6c-92f8-753004422822 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:33.176361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d647afff-2072-4d6c-92f8-753004422822 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:33.176805 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d647afff-2072-4d6c-92f8-753004422822 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:33.177570 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d647afff-2072-4d6c-92f8-753004422822 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:33.178004 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d647afff-2072-4d6c-92f8-753004422822 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:33.311084 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d647afff-2072-4d6c-92f8-753004422822 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:33.313880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4ba3f13e-203a-4b65-aaf1-dafc4fff917e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:33.314822 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4ba3f13e-203a-4b65-aaf1-dafc4fff917e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:33.318746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d647afff-2072-4d6c-92f8-753004422822 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.153816 Jan 31 04:47:33.319609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 169/358] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:33 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:33.321709 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4ba3f13e-203a-4b65-aaf1-dafc4fff917e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:33.322147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4ba3f13e-203a-4b65-aaf1-dafc4fff917e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:33.322942 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4ba3f13e-203a-4b65-aaf1-dafc4fff917e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:33.323368 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4ba3f13e-203a-4b65-aaf1-dafc4fff917e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:33.455906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4ba3f13e-203a-4b65-aaf1-dafc4fff917e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:33.463114 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4ba3f13e-203a-4b65-aaf1-dafc4fff917e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.153372 Jan 31 04:47:33.463660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 190/359] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:33 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:33.865636 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-544910c7-5c59-4088-a3b7-e99494867001 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:33.866618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-544910c7-5c59-4088-a3b7-e99494867001 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:33.873001 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-544910c7-5c59-4088-a3b7-e99494867001 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:33.873439 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-544910c7-5c59-4088-a3b7-e99494867001 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:33.874199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-544910c7-5c59-4088-a3b7-e99494867001 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:33.874624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-544910c7-5c59-4088-a3b7-e99494867001 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:33.904821 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-544910c7-5c59-4088-a3b7-e99494867001 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Jan 31 04:47:33.905355 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 170/360] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:33 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:34.336320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a8473bd1-a597-4f44-9765-d5638891a939 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:34.336988 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a8473bd1-a597-4f44-9765-d5638891a939 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:34.343305 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8473bd1-a597-4f44-9765-d5638891a939 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:34.343743 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8473bd1-a597-4f44-9765-d5638891a939 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:34.344590 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8473bd1-a597-4f44-9765-d5638891a939 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:34.345526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8473bd1-a597-4f44-9765-d5638891a939 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:34.479785 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a8473bd1-a597-4f44-9765-d5638891a939 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:34.480362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-38c95050-8c1a-44d8-99d3-9cc9ce2748f3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:34.480959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-38c95050-8c1a-44d8-99d3-9cc9ce2748f3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:34.487692 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-38c95050-8c1a-44d8-99d3-9cc9ce2748f3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:34.487904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a8473bd1-a597-4f44-9765-d5638891a939 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.155364 Jan 31 04:47:34.488128 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-38c95050-8c1a-44d8-99d3-9cc9ce2748f3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:34.488475 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 191/361] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:34 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:34.488896 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-38c95050-8c1a-44d8-99d3-9cc9ce2748f3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:34.489320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-38c95050-8c1a-44d8-99d3-9cc9ce2748f3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:34.620668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-38c95050-8c1a-44d8-99d3-9cc9ce2748f3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:34.628716 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-38c95050-8c1a-44d8-99d3-9cc9ce2748f3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.151961 Jan 31 04:47:34.629519 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 171/362] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:34 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:34.915997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b4e6e57e-8655-482f-9814-adb0ac8dbf9d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:34.916962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b4e6e57e-8655-482f-9814-adb0ac8dbf9d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:34.922660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4e6e57e-8655-482f-9814-adb0ac8dbf9d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:34.923811 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4e6e57e-8655-482f-9814-adb0ac8dbf9d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:34.924574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4e6e57e-8655-482f-9814-adb0ac8dbf9d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:34.925002 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4e6e57e-8655-482f-9814-adb0ac8dbf9d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:34.953137 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b4e6e57e-8655-482f-9814-adb0ac8dbf9d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040745 Jan 31 04:47:34.953670 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 192/363] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:34 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:35.511724 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-50dd7af2-a871-47a5-a1c2-0c45d507bfe4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:35.512457 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-50dd7af2-a871-47a5-a1c2-0c45d507bfe4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:35.519781 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50dd7af2-a871-47a5-a1c2-0c45d507bfe4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:35.520326 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50dd7af2-a871-47a5-a1c2-0c45d507bfe4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:35.521177 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50dd7af2-a871-47a5-a1c2-0c45d507bfe4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:35.521692 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50dd7af2-a871-47a5-a1c2-0c45d507bfe4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:35.647451 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3718ff13-30a1-4cd1-83fa-667f3c5c542b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:35.648063 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3718ff13-30a1-4cd1-83fa-667f3c5c542b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:35.654749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3718ff13-30a1-4cd1-83fa-667f3c5c542b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:35.655229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3718ff13-30a1-4cd1-83fa-667f3c5c542b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:35.656011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3718ff13-30a1-4cd1-83fa-667f3c5c542b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:35.656503 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3718ff13-30a1-4cd1-83fa-667f3c5c542b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:35.658141 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-50dd7af2-a871-47a5-a1c2-0c45d507bfe4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:35.667475 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-50dd7af2-a871-47a5-a1c2-0c45d507bfe4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.159482 Jan 31 04:47:35.668044 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 172/364] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:35 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:35.794064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3718ff13-30a1-4cd1-83fa-667f3c5c542b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:35.802074 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3718ff13-30a1-4cd1-83fa-667f3c5c542b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.160428 Jan 31 04:47:35.802630 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 193/365] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:35 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:35.964126 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3fdd445a-2247-4c15-83eb-8ff7a965f6bf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:35.965041 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3fdd445a-2247-4c15-83eb-8ff7a965f6bf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:35.971405 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fdd445a-2247-4c15-83eb-8ff7a965f6bf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:35.971855 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fdd445a-2247-4c15-83eb-8ff7a965f6bf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:35.972633 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fdd445a-2247-4c15-83eb-8ff7a965f6bf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:35.973064 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fdd445a-2247-4c15-83eb-8ff7a965f6bf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:36.001026 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3fdd445a-2247-4c15-83eb-8ff7a965f6bf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040581 Jan 31 04:47:36.001569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 173/366] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:35 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:36.684730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-14446fbc-b61c-4148-8e6c-d4460e0a78a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:36.685283 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-14446fbc-b61c-4148-8e6c-d4460e0a78a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:36.692295 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14446fbc-b61c-4148-8e6c-d4460e0a78a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:36.692732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14446fbc-b61c-4148-8e6c-d4460e0a78a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:36.693507 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14446fbc-b61c-4148-8e6c-d4460e0a78a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:36.693948 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14446fbc-b61c-4148-8e6c-d4460e0a78a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:36.819492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-31e68f88-6fe6-4bca-8727-66e5f1645ea9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:36.821078 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-31e68f88-6fe6-4bca-8727-66e5f1645ea9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:36.823290 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-14446fbc-b61c-4148-8e6c-d4460e0a78a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:36.828087 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31e68f88-6fe6-4bca-8727-66e5f1645ea9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:36.828678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31e68f88-6fe6-4bca-8727-66e5f1645ea9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:36.829460 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31e68f88-6fe6-4bca-8727-66e5f1645ea9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:36.829978 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31e68f88-6fe6-4bca-8727-66e5f1645ea9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:36.831802 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-14446fbc-b61c-4148-8e6c-d4460e0a78a2 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.150642 Jan 31 04:47:36.832826 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 194/367] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:36 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:36.982503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-31e68f88-6fe6-4bca-8727-66e5f1645ea9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:36.991055 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-31e68f88-6fe6-4bca-8727-66e5f1645ea9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.175449 Jan 31 04:47:36.991633 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 174/368] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:36 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:37.014015 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-50b76d2a-e63b-4b54-a236-cc8c53a38241 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:37.015549 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-50b76d2a-e63b-4b54-a236-cc8c53a38241 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:37.022072 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-50b76d2a-e63b-4b54-a236-cc8c53a38241 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:37.022607 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-50b76d2a-e63b-4b54-a236-cc8c53a38241 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:37.023675 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-50b76d2a-e63b-4b54-a236-cc8c53a38241 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:37.025194 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-50b76d2a-e63b-4b54-a236-cc8c53a38241 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:37.062289 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-50b76d2a-e63b-4b54-a236-cc8c53a38241 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052512 Jan 31 04:47:37.062996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 195/369] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:37 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:37.847633 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3bedad21-3e81-42ca-97a2-3e0ddc4d8fe6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:37.848258 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3bedad21-3e81-42ca-97a2-3e0ddc4d8fe6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:37.854489 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3bedad21-3e81-42ca-97a2-3e0ddc4d8fe6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:37.854968 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3bedad21-3e81-42ca-97a2-3e0ddc4d8fe6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:37.855816 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3bedad21-3e81-42ca-97a2-3e0ddc4d8fe6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:37.856250 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3bedad21-3e81-42ca-97a2-3e0ddc4d8fe6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:37.985516 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3bedad21-3e81-42ca-97a2-3e0ddc4d8fe6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:37.992892 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3bedad21-3e81-42ca-97a2-3e0ddc4d8fe6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.148931 Jan 31 04:47:37.993446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 175/370] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:37 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:38.008275 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-fc80ebd0-a817-423f-b249-71e469a79cbf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:38.008875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-fc80ebd0-a817-423f-b249-71e469a79cbf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:38.014939 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fc80ebd0-a817-423f-b249-71e469a79cbf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:38.015376 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fc80ebd0-a817-423f-b249-71e469a79cbf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:38.016133 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fc80ebd0-a817-423f-b249-71e469a79cbf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:38.017181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fc80ebd0-a817-423f-b249-71e469a79cbf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:38.073381 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a45335ff-d9ed-4342-ac19-3d351bc650cb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:38.074338 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a45335ff-d9ed-4342-ac19-3d351bc650cb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:38.081193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a45335ff-d9ed-4342-ac19-3d351bc650cb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:38.081823 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a45335ff-d9ed-4342-ac19-3d351bc650cb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:38.082747 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a45335ff-d9ed-4342-ac19-3d351bc650cb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:38.083395 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a45335ff-d9ed-4342-ac19-3d351bc650cb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:38.113827 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a45335ff-d9ed-4342-ac19-3d351bc650cb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Jan 31 04:47:38.114387 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 176/371] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:38 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:47:38.162344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fc80ebd0-a817-423f-b249-71e469a79cbf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:38.169534 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-fc80ebd0-a817-423f-b249-71e469a79cbf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.164874 Jan 31 04:47:38.170120 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 196/372] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:38 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:39.009390 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9ab6342a-5b03-41a3-b3f4-a33a72f8d62c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:39.009989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9ab6342a-5b03-41a3-b3f4-a33a72f8d62c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:39.016115 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ab6342a-5b03-41a3-b3f4-a33a72f8d62c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:39.017095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ab6342a-5b03-41a3-b3f4-a33a72f8d62c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:39.018016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ab6342a-5b03-41a3-b3f4-a33a72f8d62c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:39.018445 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ab6342a-5b03-41a3-b3f4-a33a72f8d62c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:39.124956 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5ed0d814-9bc3-440d-bef5-028be2ef65ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:39.125918 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5ed0d814-9bc3-440d-bef5-028be2ef65ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:39.132629 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5ed0d814-9bc3-440d-bef5-028be2ef65ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:39.133085 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5ed0d814-9bc3-440d-bef5-028be2ef65ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:39.133863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5ed0d814-9bc3-440d-bef5-028be2ef65ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:39.134474 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5ed0d814-9bc3-440d-bef5-028be2ef65ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:39.157884 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9ab6342a-5b03-41a3-b3f4-a33a72f8d62c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:39.165090 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9ab6342a-5b03-41a3-b3f4-a33a72f8d62c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.159252 Jan 31 04:47:39.165228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5ed0d814-9bc3-440d-bef5-028be2ef65ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Jan 31 04:47:39.165907 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 197/373] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:39 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:47:39.166063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 177/374] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:39 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:39.186129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-89e4de57-9d3b-4b86-ade1-d301e27e4a86 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:39.186722 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-89e4de57-9d3b-4b86-ade1-d301e27e4a86 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:39.192512 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-89e4de57-9d3b-4b86-ade1-d301e27e4a86 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:39.192971 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-89e4de57-9d3b-4b86-ade1-d301e27e4a86 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:39.193739 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-89e4de57-9d3b-4b86-ade1-d301e27e4a86 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:39.194175 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-89e4de57-9d3b-4b86-ade1-d301e27e4a86 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:39.364733 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-89e4de57-9d3b-4b86-ade1-d301e27e4a86 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:39.364733 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-89e4de57-9d3b-4b86-ade1-d301e27e4a86 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.155421 Jan 31 04:47:39.364733 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 198/375] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:39 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:40.011140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-4a159dbf-bfb1-402b-adbd-23bc35bf8b47 req-50cf9df3-caa8-4a10-a0e6-d07e9eed9006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b864423-6740-4f17-848e-ab7213f4ceab", "name": "network-vif-plugged", "status": "completed", "tag": "f8fdd1ca-9af9-4dbb-9ecf-1f7188a736a6"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:40.012755 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:47:40.012755 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:47:40.020136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-4a159dbf-bfb1-402b-adbd-23bc35bf8b47 req-50cf9df3-caa8-4a10-a0e6-d07e9eed9006 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:40.020569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-4a159dbf-bfb1-402b-adbd-23bc35bf8b47 req-50cf9df3-caa8-4a10-a0e6-d07e9eed9006 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:40.030745 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-4a159dbf-bfb1-402b-adbd-23bc35bf8b47 req-50cf9df3-caa8-4a10-a0e6-d07e9eed9006 service nova] Creating event network-vif-plugged:f8fdd1ca-9af9-4dbb-9ecf-1f7188a736a6 for instance 2b864423-6740-4f17-848e-ab7213f4ceab on hv-cinder-82660 Jan 31 04:47:40.036700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-4a159dbf-bfb1-402b-adbd-23bc35bf8b47 req-50cf9df3-caa8-4a10-a0e6-d07e9eed9006 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029343 Jan 31 04:47:40.037389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 178/376] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:40.178217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-abbf700b-4d45-4224-afd1-6b529c9cc5cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:40.179983 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-abbf700b-4d45-4224-afd1-6b529c9cc5cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:40.182536 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e357f2b6-8a03-46eb-bd87-36878ead981f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:40.183253 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e357f2b6-8a03-46eb-bd87-36878ead981f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:40.186870 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-abbf700b-4d45-4224-afd1-6b529c9cc5cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:40.187326 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-abbf700b-4d45-4224-afd1-6b529c9cc5cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:40.188155 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-abbf700b-4d45-4224-afd1-6b529c9cc5cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:40.188794 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-abbf700b-4d45-4224-afd1-6b529c9cc5cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:40.189979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e357f2b6-8a03-46eb-bd87-36878ead981f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:40.190618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e357f2b6-8a03-46eb-bd87-36878ead981f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:40.191426 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e357f2b6-8a03-46eb-bd87-36878ead981f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:40.192173 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e357f2b6-8a03-46eb-bd87-36878ead981f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:40.222712 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-abbf700b-4d45-4224-afd1-6b529c9cc5cf tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049975 Jan 31 04:47:40.223307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 199/377] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:40 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:40.326623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e357f2b6-8a03-46eb-bd87-36878ead981f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:40.333861 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e357f2b6-8a03-46eb-bd87-36878ead981f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.155296 Jan 31 04:47:40.334422 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 179/378] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:40 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:40.354532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-036bcf91-f41c-4672-90c2-84fc2868b5c9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:40.355159 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-036bcf91-f41c-4672-90c2-84fc2868b5c9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:40.362094 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-036bcf91-f41c-4672-90c2-84fc2868b5c9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:40.362665 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-036bcf91-f41c-4672-90c2-84fc2868b5c9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:40.363501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-036bcf91-f41c-4672-90c2-84fc2868b5c9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:40.363932 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-036bcf91-f41c-4672-90c2-84fc2868b5c9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:40.543206 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-036bcf91-f41c-4672-90c2-84fc2868b5c9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:40.552044 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-036bcf91-f41c-4672-90c2-84fc2868b5c9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.201179 Jan 31 04:47:40.552608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 200/379] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:40 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:41.233321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-51aa89cf-d8d5-430d-b395-dc2ce4e750d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:41.234254 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-51aa89cf-d8d5-430d-b395-dc2ce4e750d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:41.240851 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-51aa89cf-d8d5-430d-b395-dc2ce4e750d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:41.241288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-51aa89cf-d8d5-430d-b395-dc2ce4e750d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:41.242048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-51aa89cf-d8d5-430d-b395-dc2ce4e750d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:41.242471 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-51aa89cf-d8d5-430d-b395-dc2ce4e750d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:41.271738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-51aa89cf-d8d5-430d-b395-dc2ce4e750d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042081 Jan 31 04:47:41.274634 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 180/380] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:41 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:41.350670 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8e1a52f4-939f-4310-8a29-daa87ae66c0a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:41.351258 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8e1a52f4-939f-4310-8a29-daa87ae66c0a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:41.357532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-939f-4310-8a29-daa87ae66c0a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:41.357973 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-939f-4310-8a29-daa87ae66c0a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:41.358741 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-939f-4310-8a29-daa87ae66c0a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:41.359245 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-939f-4310-8a29-daa87ae66c0a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:41.494461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8e1a52f4-939f-4310-8a29-daa87ae66c0a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:41.501662 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8e1a52f4-939f-4310-8a29-daa87ae66c0a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.154791 Jan 31 04:47:41.502236 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 201/381] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:41 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:41.567790 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-dfebad04-4387-4fd7-8496-db523b6978f0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:41.568393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-dfebad04-4387-4fd7-8496-db523b6978f0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:41.574120 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dfebad04-4387-4fd7-8496-db523b6978f0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:41.574562 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dfebad04-4387-4fd7-8496-db523b6978f0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:41.575361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dfebad04-4387-4fd7-8496-db523b6978f0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:41.575793 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dfebad04-4387-4fd7-8496-db523b6978f0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:41.708784 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-dfebad04-4387-4fd7-8496-db523b6978f0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:41.715860 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-dfebad04-4387-4fd7-8496-db523b6978f0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.151745 Jan 31 04:47:41.716410 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 181/382] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:41 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:42.284417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2e2232df-cfcc-4bd0-979e-1dc90f1059d5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:42.285851 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2e2232df-cfcc-4bd0-979e-1dc90f1059d5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:42.293091 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2e2232df-cfcc-4bd0-979e-1dc90f1059d5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:42.293533 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2e2232df-cfcc-4bd0-979e-1dc90f1059d5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:42.294531 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2e2232df-cfcc-4bd0-979e-1dc90f1059d5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:42.295294 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2e2232df-cfcc-4bd0-979e-1dc90f1059d5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:42.327795 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2e2232df-cfcc-4bd0-979e-1dc90f1059d5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048149 Jan 31 04:47:42.332296 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 202/383] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:42 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:42.519193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-934a3d98-0b9c-4c42-99fc-7230046a9734 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:42.519850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-934a3d98-0b9c-4c42-99fc-7230046a9734 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:42.525977 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-934a3d98-0b9c-4c42-99fc-7230046a9734 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:42.526420 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-934a3d98-0b9c-4c42-99fc-7230046a9734 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:42.527225 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-934a3d98-0b9c-4c42-99fc-7230046a9734 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:42.527656 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-934a3d98-0b9c-4c42-99fc-7230046a9734 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:42.657545 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-934a3d98-0b9c-4c42-99fc-7230046a9734 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:42.664787 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-934a3d98-0b9c-4c42-99fc-7230046a9734 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.150264 Jan 31 04:47:42.665343 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 182/384] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:42 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:42.732666 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9cc87300-fd53-40f5-9b3e-441357039d64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:42.733300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9cc87300-fd53-40f5-9b3e-441357039d64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:42.740067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9cc87300-fd53-40f5-9b3e-441357039d64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:42.740508 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9cc87300-fd53-40f5-9b3e-441357039d64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:42.741273 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9cc87300-fd53-40f5-9b3e-441357039d64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:42.741701 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9cc87300-fd53-40f5-9b3e-441357039d64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:42.871051 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9cc87300-fd53-40f5-9b3e-441357039d64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:42.879292 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9cc87300-fd53-40f5-9b3e-441357039d64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.149871 Jan 31 04:47:42.879853 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 203/385] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:42 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:43.339834 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2cced449-dd56-4cc0-a093-a56d16b745d4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:43.342064 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2cced449-dd56-4cc0-a093-a56d16b745d4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:43.348376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2cced449-dd56-4cc0-a093-a56d16b745d4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:43.348899 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2cced449-dd56-4cc0-a093-a56d16b745d4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:43.349768 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2cced449-dd56-4cc0-a093-a56d16b745d4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:43.350277 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2cced449-dd56-4cc0-a093-a56d16b745d4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:43.379890 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2cced449-dd56-4cc0-a093-a56d16b745d4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Jan 31 04:47:43.380438 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 183/386] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:43 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:43.681150 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-96a80ed1-ac6d-4932-b28d-cc9226d13197 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:43.681749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-96a80ed1-ac6d-4932-b28d-cc9226d13197 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:43.687842 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96a80ed1-ac6d-4932-b28d-cc9226d13197 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:43.688281 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96a80ed1-ac6d-4932-b28d-cc9226d13197 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:43.689177 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96a80ed1-ac6d-4932-b28d-cc9226d13197 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:43.689610 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96a80ed1-ac6d-4932-b28d-cc9226d13197 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:43.818537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-96a80ed1-ac6d-4932-b28d-cc9226d13197 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:43.825670 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-96a80ed1-ac6d-4932-b28d-cc9226d13197 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.148097 Jan 31 04:47:43.826223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 204/387] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:43 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:43.895976 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-25585220-461e-4ec6-b04d-adefa3988091 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:43.896572 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-25585220-461e-4ec6-b04d-adefa3988091 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:43.902640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25585220-461e-4ec6-b04d-adefa3988091 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:43.903112 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25585220-461e-4ec6-b04d-adefa3988091 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:43.903866 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25585220-461e-4ec6-b04d-adefa3988091 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:43.904291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25585220-461e-4ec6-b04d-adefa3988091 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:44.032208 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-25585220-461e-4ec6-b04d-adefa3988091 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:44.039949 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-25585220-461e-4ec6-b04d-adefa3988091 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.148200 Jan 31 04:47:44.040503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 184/388] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:43 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:44.391182 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-45b9de22-4b80-448d-adce-4aa1b178c1ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:44.392157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-45b9de22-4b80-448d-adce-4aa1b178c1ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:44.398461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-45b9de22-4b80-448d-adce-4aa1b178c1ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:44.398939 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-45b9de22-4b80-448d-adce-4aa1b178c1ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:44.399719 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-45b9de22-4b80-448d-adce-4aa1b178c1ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:44.400147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-45b9de22-4b80-448d-adce-4aa1b178c1ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:44.429601 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-45b9de22-4b80-448d-adce-4aa1b178c1ff tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Jan 31 04:47:44.430156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 205/389] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:44 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:44.842364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-46116d92-1e55-4dff-a19a-0f0d83f4890e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:44.843000 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-46116d92-1e55-4dff-a19a-0f0d83f4890e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:44.849520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46116d92-1e55-4dff-a19a-0f0d83f4890e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:44.849968 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46116d92-1e55-4dff-a19a-0f0d83f4890e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:44.850738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46116d92-1e55-4dff-a19a-0f0d83f4890e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:44.851202 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46116d92-1e55-4dff-a19a-0f0d83f4890e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:44.981112 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-46116d92-1e55-4dff-a19a-0f0d83f4890e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:44.988496 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-46116d92-1e55-4dff-a19a-0f0d83f4890e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.149668 Jan 31 04:47:44.989049 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 185/390] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:44 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:45.056342 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0ebf75c2-a0d5-46c8-b504-308f609eaf12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:45.056976 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0ebf75c2-a0d5-46c8-b504-308f609eaf12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:45.063188 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0ebf75c2-a0d5-46c8-b504-308f609eaf12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:45.063634 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0ebf75c2-a0d5-46c8-b504-308f609eaf12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:45.064606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0ebf75c2-a0d5-46c8-b504-308f609eaf12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:45.065059 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0ebf75c2-a0d5-46c8-b504-308f609eaf12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:45.198854 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0ebf75c2-a0d5-46c8-b504-308f609eaf12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:45.206510 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0ebf75c2-a0d5-46c8-b504-308f609eaf12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.153796 Jan 31 04:47:45.207102 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 206/391] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:45 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:45.441376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-de851ba0-e767-4e73-92e6-2854d3c57d48 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:45.442288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-de851ba0-e767-4e73-92e6-2854d3c57d48 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:45.448284 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de851ba0-e767-4e73-92e6-2854d3c57d48 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:45.448723 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de851ba0-e767-4e73-92e6-2854d3c57d48 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:45.449490 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de851ba0-e767-4e73-92e6-2854d3c57d48 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:45.449915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de851ba0-e767-4e73-92e6-2854d3c57d48 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:45.478094 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-de851ba0-e767-4e73-92e6-2854d3c57d48 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Jan 31 04:47:45.478625 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 186/392] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:45 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:46.005165 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-76ab781f-4dec-4694-a699-6d5374dc729e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:46.005774 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-76ab781f-4dec-4694-a699-6d5374dc729e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:46.011534 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-76ab781f-4dec-4694-a699-6d5374dc729e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:46.011932 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-76ab781f-4dec-4694-a699-6d5374dc729e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:46.012704 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-76ab781f-4dec-4694-a699-6d5374dc729e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:46.013142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-76ab781f-4dec-4694-a699-6d5374dc729e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:46.140867 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-76ab781f-4dec-4694-a699-6d5374dc729e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:46.148453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-76ab781f-4dec-4694-a699-6d5374dc729e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.147400 Jan 31 04:47:46.149010 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 207/393] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:45 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:46.223731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8ea2abd2-09dc-463b-8708-6c38d2b510f1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:46.224335 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8ea2abd2-09dc-463b-8708-6c38d2b510f1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:46.230464 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8ea2abd2-09dc-463b-8708-6c38d2b510f1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:46.230944 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8ea2abd2-09dc-463b-8708-6c38d2b510f1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:46.231706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8ea2abd2-09dc-463b-8708-6c38d2b510f1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:46.232140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8ea2abd2-09dc-463b-8708-6c38d2b510f1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:46.364417 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8ea2abd2-09dc-463b-8708-6c38d2b510f1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:46.371523 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8ea2abd2-09dc-463b-8708-6c38d2b510f1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.152368 Jan 31 04:47:46.372069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 187/394] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:46 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:46.489626 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-74ea635a-fb1f-4e6c-b9c4-0f7e90eaa327 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:46.490652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-74ea635a-fb1f-4e6c-b9c4-0f7e90eaa327 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:46.496439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74ea635a-fb1f-4e6c-b9c4-0f7e90eaa327 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:46.496887 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74ea635a-fb1f-4e6c-b9c4-0f7e90eaa327 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:46.497651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74ea635a-fb1f-4e6c-b9c4-0f7e90eaa327 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:46.498081 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74ea635a-fb1f-4e6c-b9c4-0f7e90eaa327 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:46.527449 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-74ea635a-fb1f-4e6c-b9c4-0f7e90eaa327 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Jan 31 04:47:46.527991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 208/395] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:46 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:47.165098 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c68f8b4d-6238-4a0f-8bd2-7a55fb523d28 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:47.165812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c68f8b4d-6238-4a0f-8bd2-7a55fb523d28 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:47.171593 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c68f8b4d-6238-4a0f-8bd2-7a55fb523d28 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:47.171990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c68f8b4d-6238-4a0f-8bd2-7a55fb523d28 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:47.172753 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c68f8b4d-6238-4a0f-8bd2-7a55fb523d28 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:47.173185 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c68f8b4d-6238-4a0f-8bd2-7a55fb523d28 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:47.307569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c68f8b4d-6238-4a0f-8bd2-7a55fb523d28 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:47.314723 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c68f8b4d-6238-4a0f-8bd2-7a55fb523d28 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.153304 Jan 31 04:47:47.315303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 188/396] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:47 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:47.388516 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-08d73b25-b3d9-4bbf-8704-ee3d749f389a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:47.389115 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-08d73b25-b3d9-4bbf-8704-ee3d749f389a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:47.396010 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-08d73b25-b3d9-4bbf-8704-ee3d749f389a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:47.396454 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-08d73b25-b3d9-4bbf-8704-ee3d749f389a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:47.397236 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-08d73b25-b3d9-4bbf-8704-ee3d749f389a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:47.397690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-08d73b25-b3d9-4bbf-8704-ee3d749f389a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:47.539288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-13fb6370-ff98-434e-8a17-e91793e05667 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:47.540315 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-13fb6370-ff98-434e-8a17-e91793e05667 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:47.541566 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-08d73b25-b3d9-4bbf-8704-ee3d749f389a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:47.546163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-13fb6370-ff98-434e-8a17-e91793e05667 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:47.549505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-13fb6370-ff98-434e-8a17-e91793e05667 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:47.549505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-13fb6370-ff98-434e-8a17-e91793e05667 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:47.549505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-13fb6370-ff98-434e-8a17-e91793e05667 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:47.549759 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-08d73b25-b3d9-4bbf-8704-ee3d749f389a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1363 microversion: 2.1 time: 0.163753 Jan 31 04:47:47.549759 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 209/397] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:47 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:47.578754 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-13fb6370-ff98-434e-8a17-e91793e05667 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Jan 31 04:47:47.579343 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 189/398] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:47 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:47:48.332430 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c2089baf-b3b0-4e91-bb18-c45168a01b7a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:48.334992 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c2089baf-b3b0-4e91-bb18-c45168a01b7a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:48.338745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2089baf-b3b0-4e91-bb18-c45168a01b7a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:48.339218 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2089baf-b3b0-4e91-bb18-c45168a01b7a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:48.339987 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2089baf-b3b0-4e91-bb18-c45168a01b7a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:48.340420 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2089baf-b3b0-4e91-bb18-c45168a01b7a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:48.470485 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c2089baf-b3b0-4e91-bb18-c45168a01b7a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:48.478512 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c2089baf-b3b0-4e91-bb18-c45168a01b7a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.150322 Jan 31 04:47:48.479100 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 210/399] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:48 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:48.566896 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a4057eb2-d6c1-49a3-988e-aa0694b06d12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:48.567508 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a4057eb2-d6c1-49a3-988e-aa0694b06d12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:48.573839 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a4057eb2-d6c1-49a3-988e-aa0694b06d12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:48.574100 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a4057eb2-d6c1-49a3-988e-aa0694b06d12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:48.574893 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a4057eb2-d6c1-49a3-988e-aa0694b06d12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:48.575329 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a4057eb2-d6c1-49a3-988e-aa0694b06d12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:48.589580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-69183c47-38a2-4492-b7e6-b7e2f06e76fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:48.590483 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-69183c47-38a2-4492-b7e6-b7e2f06e76fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:48.596214 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69183c47-38a2-4492-b7e6-b7e2f06e76fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:48.596660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69183c47-38a2-4492-b7e6-b7e2f06e76fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:48.597528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69183c47-38a2-4492-b7e6-b7e2f06e76fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:48.597969 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69183c47-38a2-4492-b7e6-b7e2f06e76fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:48.631433 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-69183c47-38a2-4492-b7e6-b7e2f06e76fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Jan 31 04:47:48.631991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 211/400] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:48 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:47:48.704136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a4057eb2-d6c1-49a3-988e-aa0694b06d12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:48.712003 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a4057eb2-d6c1-49a3-988e-aa0694b06d12 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1550 microversion: 2.1 time: 0.149377 Jan 31 04:47:48.712568 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 190/401] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:48 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:48.727778 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6f17b419-da9c-4707-9015-410e7b5b3a55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:48.728359 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6f17b419-da9c-4707-9015-410e7b5b3a55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:48.734079 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6f17b419-da9c-4707-9015-410e7b5b3a55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:48.734517 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6f17b419-da9c-4707-9015-410e7b5b3a55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:48.735313 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6f17b419-da9c-4707-9015-410e7b5b3a55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:48.735745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6f17b419-da9c-4707-9015-410e7b5b3a55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:48.818063 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6f17b419-da9c-4707-9015-410e7b5b3a55 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093778 Jan 31 04:47:48.818647 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 212/402] 10.222.0.21 () {58 vars in 1274 bytes} [Mon Jan 31 04:47:48 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:49.495890 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-95acd144-63c8-4b0d-941b-879123e34e13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:49.496488 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-95acd144-63c8-4b0d-941b-879123e34e13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:49.502752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-95acd144-63c8-4b0d-941b-879123e34e13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:49.503286 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-95acd144-63c8-4b0d-941b-879123e34e13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:49.504321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-95acd144-63c8-4b0d-941b-879123e34e13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:49.504743 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-95acd144-63c8-4b0d-941b-879123e34e13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:49.645157 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-95acd144-63c8-4b0d-941b-879123e34e13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:49.651377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3bff581c-54ca-4881-bbcf-b6018a849a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:49.652536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3bff581c-54ca-4881-bbcf-b6018a849a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:49.652646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-95acd144-63c8-4b0d-941b-879123e34e13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.160748 Jan 31 04:47:49.653169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 191/403] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:49 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:49.658898 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3bff581c-54ca-4881-bbcf-b6018a849a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:49.660031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3bff581c-54ca-4881-bbcf-b6018a849a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:49.661068 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3bff581c-54ca-4881-bbcf-b6018a849a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:49.661608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3bff581c-54ca-4881-bbcf-b6018a849a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:49.691500 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3bff581c-54ca-4881-bbcf-b6018a849a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Jan 31 04:47:49.692054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 213/404] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:49 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:50.198714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d465f0a1-e15e-4dfe-8779-a6642cdebc16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:50.199356 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d465f0a1-e15e-4dfe-8779-a6642cdebc16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:50.202085 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-bd48d2c6-9b62-4023-84b6-aa3e99508587 req-7ffd9eed-13a0-4308-9f0d-3d3f918af409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b864423-6740-4f17-848e-ab7213f4ceab", "tag": "f8fdd1ca-9af9-4dbb-9ecf-1f7188a736a6"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:50.204201 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:47:50.204201 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:47:50.205360 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d465f0a1-e15e-4dfe-8779-a6642cdebc16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:50.205813 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d465f0a1-e15e-4dfe-8779-a6642cdebc16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:50.207506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d465f0a1-e15e-4dfe-8779-a6642cdebc16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:50.208118 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d465f0a1-e15e-4dfe-8779-a6642cdebc16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:50.213084 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-bd48d2c6-9b62-4023-84b6-aa3e99508587 req-7ffd9eed-13a0-4308-9f0d-3d3f918af409 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:50.213629 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-bd48d2c6-9b62-4023-84b6-aa3e99508587 req-7ffd9eed-13a0-4308-9f0d-3d3f918af409 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:50.225502 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-bd48d2c6-9b62-4023-84b6-aa3e99508587 req-7ffd9eed-13a0-4308-9f0d-3d3f918af409 service nova] Creating event network-changed:f8fdd1ca-9af9-4dbb-9ecf-1f7188a736a6 for instance 2b864423-6740-4f17-848e-ab7213f4ceab on hv-cinder-82660 Jan 31 04:47:50.231086 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-bd48d2c6-9b62-4023-84b6-aa3e99508587 req-7ffd9eed-13a0-4308-9f0d-3d3f918af409 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033146 Jan 31 04:47:50.232100 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 214/405] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:47:50.342597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d465f0a1-e15e-4dfe-8779-a6642cdebc16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:50.350140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d465f0a1-e15e-4dfe-8779-a6642cdebc16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1550 microversion: 2.1 time: 0.155215 Jan 31 04:47:50.350709 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 192/406] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:50 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:50.669830 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8e564a5d-22df-43ec-ab3e-89c31800cfb8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:50.670531 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8e564a5d-22df-43ec-ab3e-89c31800cfb8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:50.677760 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8e564a5d-22df-43ec-ab3e-89c31800cfb8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:50.678206 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8e564a5d-22df-43ec-ab3e-89c31800cfb8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:50.679038 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8e564a5d-22df-43ec-ab3e-89c31800cfb8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:50.679471 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8e564a5d-22df-43ec-ab3e-89c31800cfb8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:50.702085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cb8bb341-e1dd-42e6-acfb-a13a4ef9ac68 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:50.703148 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cb8bb341-e1dd-42e6-acfb-a13a4ef9ac68 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:50.709874 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cb8bb341-e1dd-42e6-acfb-a13a4ef9ac68 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:50.710594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cb8bb341-e1dd-42e6-acfb-a13a4ef9ac68 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:50.711593 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cb8bb341-e1dd-42e6-acfb-a13a4ef9ac68 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:50.712245 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cb8bb341-e1dd-42e6-acfb-a13a4ef9ac68 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:50.742361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cb8bb341-e1dd-42e6-acfb-a13a4ef9ac68 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Jan 31 04:47:50.743490 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 193/407] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:50 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:47:50.811884 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8e564a5d-22df-43ec-ab3e-89c31800cfb8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:50.819875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8e564a5d-22df-43ec-ab3e-89c31800cfb8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.153964 Jan 31 04:47:50.820439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 215/408] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:50 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:51.368823 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e2daad9d-ac08-4ae8-8d96-09c47b44dd16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:51.368823 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e2daad9d-ac08-4ae8-8d96-09c47b44dd16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:51.374671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e2daad9d-ac08-4ae8-8d96-09c47b44dd16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:51.375282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e2daad9d-ac08-4ae8-8d96-09c47b44dd16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:51.376097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e2daad9d-ac08-4ae8-8d96-09c47b44dd16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:51.376533 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e2daad9d-ac08-4ae8-8d96-09c47b44dd16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:51.506157 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e2daad9d-ac08-4ae8-8d96-09c47b44dd16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:51.513293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e2daad9d-ac08-4ae8-8d96-09c47b44dd16 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1550 microversion: 2.1 time: 0.149886 Jan 31 04:47:51.513848 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 194/409] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:51 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:51.754289 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-43bf78a1-210b-4ade-a91e-0705a74f8b07 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:51.755249 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-43bf78a1-210b-4ade-a91e-0705a74f8b07 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:51.761466 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43bf78a1-210b-4ade-a91e-0705a74f8b07 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:51.761911 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43bf78a1-210b-4ade-a91e-0705a74f8b07 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:51.762679 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43bf78a1-210b-4ade-a91e-0705a74f8b07 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:51.763132 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43bf78a1-210b-4ade-a91e-0705a74f8b07 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:51.792066 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-43bf78a1-210b-4ade-a91e-0705a74f8b07 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Jan 31 04:47:51.792606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 216/410] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:51 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:51.837378 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f87ec3e6-bd4b-4a25-a53e-e82282080ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:51.837984 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f87ec3e6-bd4b-4a25-a53e-e82282080ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:51.844143 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f87ec3e6-bd4b-4a25-a53e-e82282080ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:51.844588 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f87ec3e6-bd4b-4a25-a53e-e82282080ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:51.845350 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f87ec3e6-bd4b-4a25-a53e-e82282080ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:51.845782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f87ec3e6-bd4b-4a25-a53e-e82282080ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:51.976756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f87ec3e6-bd4b-4a25-a53e-e82282080ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:51.983919 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f87ec3e6-bd4b-4a25-a53e-e82282080ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.150187 Jan 31 04:47:51.989367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 195/411] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:51 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:52.530989 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d0f28fb6-d7b2-4ab5-9d98-e8551dfb8b49 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:52.531543 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d0f28fb6-d7b2-4ab5-9d98-e8551dfb8b49 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:52.537902 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d0f28fb6-d7b2-4ab5-9d98-e8551dfb8b49 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:52.538341 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d0f28fb6-d7b2-4ab5-9d98-e8551dfb8b49 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:52.539131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d0f28fb6-d7b2-4ab5-9d98-e8551dfb8b49 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:52.539559 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d0f28fb6-d7b2-4ab5-9d98-e8551dfb8b49 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:52.671849 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d0f28fb6-d7b2-4ab5-9d98-e8551dfb8b49 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:52.679531 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d0f28fb6-d7b2-4ab5-9d98-e8551dfb8b49 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1550 microversion: 2.1 time: 0.152232 Jan 31 04:47:52.680085 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 217/412] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:52 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:52.803315 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-66df7856-6de3-423c-b493-57fe4bc76b24 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:52.804160 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-66df7856-6de3-423c-b493-57fe4bc76b24 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:52.810026 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66df7856-6de3-423c-b493-57fe4bc76b24 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:52.810472 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66df7856-6de3-423c-b493-57fe4bc76b24 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:52.811283 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66df7856-6de3-423c-b493-57fe4bc76b24 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:52.811713 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66df7856-6de3-423c-b493-57fe4bc76b24 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:52.841654 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-66df7856-6de3-423c-b493-57fe4bc76b24 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042028 Jan 31 04:47:52.842276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 196/413] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:52 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:53.000868 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-14feaa38-cba4-4bb1-98be-f91af365f094 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:53.001476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-14feaa38-cba4-4bb1-98be-f91af365f094 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:53.008153 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14feaa38-cba4-4bb1-98be-f91af365f094 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:53.008602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14feaa38-cba4-4bb1-98be-f91af365f094 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:53.009372 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14feaa38-cba4-4bb1-98be-f91af365f094 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:53.009808 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-14feaa38-cba4-4bb1-98be-f91af365f094 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:53.139521 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-14feaa38-cba4-4bb1-98be-f91af365f094 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:53.147488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-14feaa38-cba4-4bb1-98be-f91af365f094 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.150256 Jan 31 04:47:53.148241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 218/414] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:52 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:53.697047 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c7686d95-ed28-431c-94e2-0f92f763dbe3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:53.697651 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c7686d95-ed28-431c-94e2-0f92f763dbe3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:53.703901 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c7686d95-ed28-431c-94e2-0f92f763dbe3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:53.704343 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c7686d95-ed28-431c-94e2-0f92f763dbe3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:53.705111 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c7686d95-ed28-431c-94e2-0f92f763dbe3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:53.705545 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c7686d95-ed28-431c-94e2-0f92f763dbe3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:53.853579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7681743c-4c8f-47c5-a7cf-3880b5fe314d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:53.854780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7681743c-4c8f-47c5-a7cf-3880b5fe314d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:53.856310 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c7686d95-ed28-431c-94e2-0f92f763dbe3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:53.862091 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7681743c-4c8f-47c5-a7cf-3880b5fe314d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:53.863169 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7681743c-4c8f-47c5-a7cf-3880b5fe314d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:53.864848 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7681743c-4c8f-47c5-a7cf-3880b5fe314d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:53.865289 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c7686d95-ed28-431c-94e2-0f92f763dbe3 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1550 microversion: 2.1 time: 0.171854 Jan 31 04:47:53.865403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7681743c-4c8f-47c5-a7cf-3880b5fe314d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:53.866835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 197/415] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:53 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:53.895229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7681743c-4c8f-47c5-a7cf-3880b5fe314d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045287 Jan 31 04:47:53.895784 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 219/416] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:47:53 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 31 04:47:54.084576 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-735747021", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "58128fc4-bc4f-417c-908e-383736354847"}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:54.134194 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] validate_networks() for [('58128fc4-bc4f-417c-908e-383736354847', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:47:54.164696 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cfec515c-0dca-4c78-b0b3-cdca32c23779 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:54.165345 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cfec515c-0dca-4c78-b0b3-cdca32c23779 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:54.171540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cfec515c-0dca-4c78-b0b3-cdca32c23779 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:54.171984 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cfec515c-0dca-4c78-b0b3-cdca32c23779 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:54.172746 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cfec515c-0dca-4c78-b0b3-cdca32c23779 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:54.173177 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cfec515c-0dca-4c78-b0b3-cdca32c23779 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:54.331654 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cfec515c-0dca-4c78-b0b3-cdca32c23779 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:54.340546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cfec515c-0dca-4c78-b0b3-cdca32c23779 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.180103 Jan 31 04:47:54.341120 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 220/417] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:54 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:54.540531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:47:54.540954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:47:54.541428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:47:54.541865 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:47:54.542276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:47:54.551454 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:54.551906 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:54.552704 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:54.553138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:54.570812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Getting quotas for project 41828fbc91c740cfbec65e04e92a4ecc. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:47:54.574976 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Getting quotas for user 6a6f7f126c2a4cbe80f029f352c4cafd and project 41828fbc91c740cfbec65e04e92a4ecc. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:47:54.585864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:47:54.588274 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:47:54.688613 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-15ca74c0-af0c-4f2c-9e82-313ac5b5ab71 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607589 Jan 31 04:47:54.689418 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 198/418] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:47:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:47:54.702493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-512c1b6a-0819-4d5c-92eb-fed080a7469e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:54.703137 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-512c1b6a-0819-4d5c-92eb-fed080a7469e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:54.757607 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-512c1b6a-0819-4d5c-92eb-fed080a7469e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:54.764391 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-512c1b6a-0819-4d5c-92eb-fed080a7469e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1217 microversion: 2.1 time: 0.066610 Jan 31 04:47:54.764956 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 221/419] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:54 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:54.884230 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-12d41461-112d-48f1-8c43-0c85154a9292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:54.884899 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-12d41461-112d-48f1-8c43-0c85154a9292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:54.890925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-12d41461-112d-48f1-8c43-0c85154a9292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:54.893435 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-12d41461-112d-48f1-8c43-0c85154a9292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:54.893435 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-12d41461-112d-48f1-8c43-0c85154a9292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:54.893435 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-12d41461-112d-48f1-8c43-0c85154a9292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.029079 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-12d41461-112d-48f1-8c43-0c85154a9292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:55.036772 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-12d41461-112d-48f1-8c43-0c85154a9292 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1669 microversion: 2.1 time: 0.156720 Jan 31 04:47:55.037561 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 199/420] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:54 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:55.053467 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1441b4e5-c6a9-4ed2-9f60-42cd4ac416c1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:55.054188 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1441b4e5-c6a9-4ed2-9f60-42cd4ac416c1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:55.059933 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1441b4e5-c6a9-4ed2-9f60-42cd4ac416c1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.060373 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1441b4e5-c6a9-4ed2-9f60-42cd4ac416c1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.061127 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1441b4e5-c6a9-4ed2-9f60-42cd4ac416c1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.061561 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1441b4e5-c6a9-4ed2-9f60-42cd4ac416c1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.084274 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1441b4e5-c6a9-4ed2-9f60-42cd4ac416c1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/ips" status: 200 len: 147 microversion: 2.1 time: 0.034959 Jan 31 04:47:55.084832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 222/421] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Jan 31 04:47:55 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:55.357196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-627b3333-d008-4402-94fb-e4b56cdeb49b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:55.357870 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-627b3333-d008-4402-94fb-e4b56cdeb49b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:55.364424 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-627b3333-d008-4402-94fb-e4b56cdeb49b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.364876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-627b3333-d008-4402-94fb-e4b56cdeb49b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.365644 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-627b3333-d008-4402-94fb-e4b56cdeb49b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.366076 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-627b3333-d008-4402-94fb-e4b56cdeb49b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.498603 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-627b3333-d008-4402-94fb-e4b56cdeb49b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:55.506498 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-627b3333-d008-4402-94fb-e4b56cdeb49b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1501 microversion: 2.1 time: 0.152934 Jan 31 04:47:55.507107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 200/422] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:55 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:55.530361 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6525d7a8-8c6a-41c0-8476-d0c64a0366cb"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:55.531428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:55.538722 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.539183 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.539944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.540372 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.563351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] HTTP exception thrown: Cannot 'attach_volume' instance 81eea382-424b-4435-9241-e428592c98f3 while it is in vm_state rescued Jan 31 04:47:55.563920 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Returning 409 to user: Cannot 'attach_volume' instance 81eea382-424b-4435-9241-e428592c98f3 while it is in vm_state rescued {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:47:55.564711 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-09c8a7a0-89d4-4923-b5ec-24157fb843d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038248 Jan 31 04:47:55.565232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 223/423] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:47:55 2022] POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 31 04:47:55.573756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2e1654f3-9656-4010-8c5a-41819c3d44b4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:55.574198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2e1654f3-9656-4010-8c5a-41819c3d44b4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:55.579974 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2e1654f3-9656-4010-8c5a-41819c3d44b4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.580424 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2e1654f3-9656-4010-8c5a-41819c3d44b4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.581186 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2e1654f3-9656-4010-8c5a-41819c3d44b4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.581618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2e1654f3-9656-4010-8c5a-41819c3d44b4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.781825 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5ac45f95-aa16-48c1-b8d1-c3f1d5f488b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:55.782465 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5ac45f95-aa16-48c1-b8d1-c3f1d5f488b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:55.790088 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5ac45f95-aa16-48c1-b8d1-c3f1d5f488b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.790657 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5ac45f95-aa16-48c1-b8d1-c3f1d5f488b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.791485 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5ac45f95-aa16-48c1-b8d1-c3f1d5f488b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.791933 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5ac45f95-aa16-48c1-b8d1-c3f1d5f488b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.828150 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2e1654f3-9656-4010-8c5a-41819c3d44b4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/action" status: 202 len: 0 microversion: 2.1 time: 0.257746 Jan 31 04:47:55.828891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 201/424] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:47:55 2022] POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:47:55.837741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-39cfcde6-90c1-4c22-9c2a-28777cc21875 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:55.838446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-39cfcde6-90c1-4c22-9c2a-28777cc21875 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:55.844860 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-39cfcde6-90c1-4c22-9c2a-28777cc21875 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.845312 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-39cfcde6-90c1-4c22-9c2a-28777cc21875 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.846097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-39cfcde6-90c1-4c22-9c2a-28777cc21875 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:55.846535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-39cfcde6-90c1-4c22-9c2a-28777cc21875 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:55.875546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5ac45f95-aa16-48c1-b8d1-c3f1d5f488b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:55.885715 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5ac45f95-aa16-48c1-b8d1-c3f1d5f488b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1221 microversion: 2.1 time: 0.107744 Jan 31 04:47:55.887032 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 224/425] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:55 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:55.986309 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-39cfcde6-90c1-4c22-9c2a-28777cc21875 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:55.994399 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-39cfcde6-90c1-4c22-9c2a-28777cc21875 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1509 microversion: 2.1 time: 0.160563 Jan 31 04:47:55.995203 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 202/426] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:55 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:56.904312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8bee0419-756a-40e0-acee-8c916957c5d2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:56.905598 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8bee0419-756a-40e0-acee-8c916957c5d2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:56.912706 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8bee0419-756a-40e0-acee-8c916957c5d2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:56.913331 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8bee0419-756a-40e0-acee-8c916957c5d2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:56.914150 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8bee0419-756a-40e0-acee-8c916957c5d2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:56.914589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8bee0419-756a-40e0-acee-8c916957c5d2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:57.005061 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8bee0419-756a-40e0-acee-8c916957c5d2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:57.011515 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-59285e29-ecb7-491b-843e-f2f15b437f6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:57.012665 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-59285e29-ecb7-491b-843e-f2f15b437f6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:57.017648 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8bee0419-756a-40e0-acee-8c916957c5d2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1277 microversion: 2.1 time: 0.116869 Jan 31 04:47:57.018697 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 225/427] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:56 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:57.029423 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59285e29-ecb7-491b-843e-f2f15b437f6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:57.030017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59285e29-ecb7-491b-843e-f2f15b437f6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:57.030672 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59285e29-ecb7-491b-843e-f2f15b437f6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:57.031261 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59285e29-ecb7-491b-843e-f2f15b437f6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:57.172710 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-59285e29-ecb7-491b-843e-f2f15b437f6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:57.180853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-59285e29-ecb7-491b-843e-f2f15b437f6b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1509 microversion: 2.1 time: 0.172824 Jan 31 04:47:57.181636 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 203/428] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:57 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:58.034737 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1f603ee0-febb-4d13-acc8-932dea39e5e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:58.036496 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1f603ee0-febb-4d13-acc8-932dea39e5e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:58.042725 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f603ee0-febb-4d13-acc8-932dea39e5e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:58.043197 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f603ee0-febb-4d13-acc8-932dea39e5e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:58.043967 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f603ee0-febb-4d13-acc8-932dea39e5e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:58.044394 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f603ee0-febb-4d13-acc8-932dea39e5e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:58.197614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e434497b-47ab-40ff-9de5-bcc6fa98257d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:58.198366 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e434497b-47ab-40ff-9de5-bcc6fa98257d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:58.205155 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e434497b-47ab-40ff-9de5-bcc6fa98257d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:58.205619 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e434497b-47ab-40ff-9de5-bcc6fa98257d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:58.206381 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e434497b-47ab-40ff-9de5-bcc6fa98257d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:58.206853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e434497b-47ab-40ff-9de5-bcc6fa98257d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:58.292994 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1f603ee0-febb-4d13-acc8-932dea39e5e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:58.304225 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1f603ee0-febb-4d13-acc8-932dea39e5e2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.271868 Jan 31 04:47:58.304917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 226/429] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:58 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:58.356913 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e434497b-47ab-40ff-9de5-bcc6fa98257d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:58.373741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e434497b-47ab-40ff-9de5-bcc6fa98257d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1509 microversion: 2.1 time: 0.170630 Jan 31 04:47:58.373741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 204/430] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:58 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:47:58.807926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-ce609aa1-65d9-401e-9ca3-f469d15fe402 req-c1e678a9-f46b-4c2c-a273-1097acd3ad54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5466fd6b-2f35-4587-b100-45198d7240b1", "tag": "265e7198-6b49-481d-a84d-30c9eb1994ac"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:47:58.809533 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:47:58.809533 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:47:58.817375 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ce609aa1-65d9-401e-9ca3-f469d15fe402 req-c1e678a9-f46b-4c2c-a273-1097acd3ad54 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:58.823307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ce609aa1-65d9-401e-9ca3-f469d15fe402 req-c1e678a9-f46b-4c2c-a273-1097acd3ad54 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:58.829214 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-ce609aa1-65d9-401e-9ca3-f469d15fe402 req-c1e678a9-f46b-4c2c-a273-1097acd3ad54 service nova] Creating event network-changed:265e7198-6b49-481d-a84d-30c9eb1994ac for instance 5466fd6b-2f35-4587-b100-45198d7240b1 on hv-cinder-82660 Jan 31 04:47:58.834255 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-ce609aa1-65d9-401e-9ca3-f469d15fe402 req-c1e678a9-f46b-4c2c-a273-1097acd3ad54 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029958 Jan 31 04:47:58.835019 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 227/431] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:47:59.321398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7a897a6b-60d8-47c1-97ea-a1b2f332bd26 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:59.321974 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7a897a6b-60d8-47c1-97ea-a1b2f332bd26 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:59.328292 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7a897a6b-60d8-47c1-97ea-a1b2f332bd26 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:59.328825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7a897a6b-60d8-47c1-97ea-a1b2f332bd26 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:59.329543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7a897a6b-60d8-47c1-97ea-a1b2f332bd26 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:59.329976 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7a897a6b-60d8-47c1-97ea-a1b2f332bd26 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:59.388103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9539a67d-baff-4098-8145-bffc11a0f7b8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:47:59.388815 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9539a67d-baff-4098-8145-bffc11a0f7b8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:47:59.395611 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9539a67d-baff-4098-8145-bffc11a0f7b8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:59.396071 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9539a67d-baff-4098-8145-bffc11a0f7b8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:59.396944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9539a67d-baff-4098-8145-bffc11a0f7b8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:47:59.397488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9539a67d-baff-4098-8145-bffc11a0f7b8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:47:59.473465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7a897a6b-60d8-47c1-97ea-a1b2f332bd26 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:59.480847 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7a897a6b-60d8-47c1-97ea-a1b2f332bd26 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.163322 Jan 31 04:47:59.481404 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 205/432] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:59 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:47:59.631933 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9539a67d-baff-4098-8145-bffc11a0f7b8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:47:59.639284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9539a67d-baff-4098-8145-bffc11a0f7b8 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1509 microversion: 2.1 time: 0.255492 Jan 31 04:47:59.639946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 228/433] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:47:59 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:00.498126 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e7ef99ed-667b-43ae-949c-aa645a0e21ab tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:00.498735 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e7ef99ed-667b-43ae-949c-aa645a0e21ab tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:00.506469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e7ef99ed-667b-43ae-949c-aa645a0e21ab tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:00.506957 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e7ef99ed-667b-43ae-949c-aa645a0e21ab tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:00.507735 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e7ef99ed-667b-43ae-949c-aa645a0e21ab tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:00.508165 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e7ef99ed-667b-43ae-949c-aa645a0e21ab tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:00.641442 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e7ef99ed-667b-43ae-949c-aa645a0e21ab tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:00.648802 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e7ef99ed-667b-43ae-949c-aa645a0e21ab tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.154187 Jan 31 04:48:00.649311 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 206/434] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:00 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:00.656025 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-fecaea6e-949e-4233-be6e-6bc8a1ba6be4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:00.656649 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-fecaea6e-949e-4233-be6e-6bc8a1ba6be4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:00.664022 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fecaea6e-949e-4233-be6e-6bc8a1ba6be4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:00.664562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fecaea6e-949e-4233-be6e-6bc8a1ba6be4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:00.665260 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fecaea6e-949e-4233-be6e-6bc8a1ba6be4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:00.665698 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fecaea6e-949e-4233-be6e-6bc8a1ba6be4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:00.805224 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fecaea6e-949e-4233-be6e-6bc8a1ba6be4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:00.812834 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-fecaea6e-949e-4233-be6e-6bc8a1ba6be4 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1509 microversion: 2.1 time: 0.160570 Jan 31 04:48:00.813402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 229/435] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:00 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:01.667092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8b3459e3-6b90-469c-8e6a-dee9c427517b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:01.667740 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8b3459e3-6b90-469c-8e6a-dee9c427517b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:01.674045 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8b3459e3-6b90-469c-8e6a-dee9c427517b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:01.676145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8b3459e3-6b90-469c-8e6a-dee9c427517b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:01.676145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8b3459e3-6b90-469c-8e6a-dee9c427517b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:01.676377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8b3459e3-6b90-469c-8e6a-dee9c427517b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:01.812336 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8b3459e3-6b90-469c-8e6a-dee9c427517b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:01.820788 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8b3459e3-6b90-469c-8e6a-dee9c427517b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.158673 Jan 31 04:48:01.821722 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 207/436] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:01 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:01.836473 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eab0bb64-3fdb-4732-969b-0f404ded461c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:01.837088 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-eab0bb64-3fdb-4732-969b-0f404ded461c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:01.846542 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eab0bb64-3fdb-4732-969b-0f404ded461c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:01.847061 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eab0bb64-3fdb-4732-969b-0f404ded461c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:01.848031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eab0bb64-3fdb-4732-969b-0f404ded461c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:01.848629 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eab0bb64-3fdb-4732-969b-0f404ded461c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:01.992572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eab0bb64-3fdb-4732-969b-0f404ded461c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:02.000076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-eab0bb64-3fdb-4732-969b-0f404ded461c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1515 microversion: 2.1 time: 0.172475 Jan 31 04:48:02.000649 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 230/437] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:01 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:02.841481 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7f405d8e-ba37-4cd7-a6ff-ae8045838c85 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:02.842392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7f405d8e-ba37-4cd7-a6ff-ae8045838c85 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:02.849521 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f405d8e-ba37-4cd7-a6ff-ae8045838c85 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:02.849967 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f405d8e-ba37-4cd7-a6ff-ae8045838c85 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:02.850826 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f405d8e-ba37-4cd7-a6ff-ae8045838c85 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:02.851245 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f405d8e-ba37-4cd7-a6ff-ae8045838c85 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:02.988057 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7f405d8e-ba37-4cd7-a6ff-ae8045838c85 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:02.998834 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7f405d8e-ba37-4cd7-a6ff-ae8045838c85 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.158278 Jan 31 04:48:02.998834 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 208/438] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:02 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:04.014154 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e5bae76b-50ad-490e-8e64-f1b25ca8edfa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:04.014939 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e5bae76b-50ad-490e-8e64-f1b25ca8edfa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:04.022496 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e5bae76b-50ad-490e-8e64-f1b25ca8edfa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:04.023103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e5bae76b-50ad-490e-8e64-f1b25ca8edfa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:04.027944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e5bae76b-50ad-490e-8e64-f1b25ca8edfa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:04.027944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e5bae76b-50ad-490e-8e64-f1b25ca8edfa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:04.181992 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e5bae76b-50ad-490e-8e64-f1b25ca8edfa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:04.189822 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e5bae76b-50ad-490e-8e64-f1b25ca8edfa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.179356 Jan 31 04:48:04.190499 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 231/439] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:04 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:04.770683 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-00fa45ae-69f7-4ed0-aec2-98f390366409 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:04.771284 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-00fa45ae-69f7-4ed0-aec2-98f390366409 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:04.777851 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00fa45ae-69f7-4ed0-aec2-98f390366409 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:04.778300 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00fa45ae-69f7-4ed0-aec2-98f390366409 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:04.779144 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00fa45ae-69f7-4ed0-aec2-98f390366409 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:04.779585 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-00fa45ae-69f7-4ed0-aec2-98f390366409 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:04.915037 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-00fa45ae-69f7-4ed0-aec2-98f390366409 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:04.922386 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-00fa45ae-69f7-4ed0-aec2-98f390366409 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1515 microversion: 2.1 time: 0.156181 Jan 31 04:48:04.922966 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 209/440] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:04 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:04.938004 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9ce728b2-43c3-428f-9949-e05c01321c13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a5e1961-5119-4c02-9c92-76599553712a"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:04.939025 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9ce728b2-43c3-428f-9949-e05c01321c13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:04.944895 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ce728b2-43c3-428f-9949-e05c01321c13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:04.945331 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ce728b2-43c3-428f-9949-e05c01321c13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:04.946084 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ce728b2-43c3-428f-9949-e05c01321c13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:04.946507 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ce728b2-43c3-428f-9949-e05c01321c13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:05.207138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b34d3500-010f-44c2-a2d8-7478b03fb509 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:05.207756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b34d3500-010f-44c2-a2d8-7478b03fb509 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:05.214329 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b34d3500-010f-44c2-a2d8-7478b03fb509 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:05.214930 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b34d3500-010f-44c2-a2d8-7478b03fb509 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:05.215651 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b34d3500-010f-44c2-a2d8-7478b03fb509 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:05.216086 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b34d3500-010f-44c2-a2d8-7478b03fb509 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:05.352021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b34d3500-010f-44c2-a2d8-7478b03fb509 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:05.359146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b34d3500-010f-44c2-a2d8-7478b03fb509 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.155815 Jan 31 04:48:05.359714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 210/441] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:05 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:06.375758 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-16f9d76b-2e67-467a-9fd4-c5b80cda8b83 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:06.376385 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-16f9d76b-2e67-467a-9fd4-c5b80cda8b83 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:06.382903 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-16f9d76b-2e67-467a-9fd4-c5b80cda8b83 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:06.383344 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-16f9d76b-2e67-467a-9fd4-c5b80cda8b83 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:06.385907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-16f9d76b-2e67-467a-9fd4-c5b80cda8b83 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:06.385907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-16f9d76b-2e67-467a-9fd4-c5b80cda8b83 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:06.539108 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-16f9d76b-2e67-467a-9fd4-c5b80cda8b83 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:06.546512 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-16f9d76b-2e67-467a-9fd4-c5b80cda8b83 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.174540 Jan 31 04:48:06.547268 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 211/442] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:06 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:07.563423 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-71cd7b88-4760-4e65-b7a3-5c323a6396c9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:07.564038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-71cd7b88-4760-4e65-b7a3-5c323a6396c9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:07.570530 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71cd7b88-4760-4e65-b7a3-5c323a6396c9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:07.571027 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71cd7b88-4760-4e65-b7a3-5c323a6396c9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:07.571830 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71cd7b88-4760-4e65-b7a3-5c323a6396c9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:07.577725 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71cd7b88-4760-4e65-b7a3-5c323a6396c9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:07.610534 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9ce728b2-43c3-428f-9949-e05c01321c13 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.676035 Jan 31 04:48:07.611594 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 232/443] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:48:04 2022] POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments => generated 194 bytes in 2678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:48:07.718673 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-71cd7b88-4760-4e65-b7a3-5c323a6396c9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:07.726305 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-71cd7b88-4760-4e65-b7a3-5c323a6396c9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.166499 Jan 31 04:48:07.726882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 212/444] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:07 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:08.743841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-918c326c-fff7-46cf-bd8c-3fd7e14bed74 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:08.744525 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-918c326c-fff7-46cf-bd8c-3fd7e14bed74 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:08.751128 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-918c326c-fff7-46cf-bd8c-3fd7e14bed74 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:08.751554 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-918c326c-fff7-46cf-bd8c-3fd7e14bed74 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:08.752323 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-918c326c-fff7-46cf-bd8c-3fd7e14bed74 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:08.752803 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-918c326c-fff7-46cf-bd8c-3fd7e14bed74 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:08.885614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-918c326c-fff7-46cf-bd8c-3fd7e14bed74 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:08.892742 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-918c326c-fff7-46cf-bd8c-3fd7e14bed74 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.153407 Jan 31 04:48:08.893289 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 233/445] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:08 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:09.910470 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-201a9fc8-0c44-4a6b-b281-450303a99760 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:09.911173 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-201a9fc8-0c44-4a6b-b281-450303a99760 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:09.917621 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-201a9fc8-0c44-4a6b-b281-450303a99760 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:09.918070 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-201a9fc8-0c44-4a6b-b281-450303a99760 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:09.918929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-201a9fc8-0c44-4a6b-b281-450303a99760 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:09.919364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-201a9fc8-0c44-4a6b-b281-450303a99760 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:10.047552 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-201a9fc8-0c44-4a6b-b281-450303a99760 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:10.055085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-201a9fc8-0c44-4a6b-b281-450303a99760 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.149042 Jan 31 04:48:10.055639 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 213/446] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:09 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:11.072863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-37a431cd-f0c8-49c0-918a-228725f077b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:11.073487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-37a431cd-f0c8-49c0-918a-228725f077b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:11.079687 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-37a431cd-f0c8-49c0-918a-228725f077b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:11.084362 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-37a431cd-f0c8-49c0-918a-228725f077b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:11.084362 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-37a431cd-f0c8-49c0-918a-228725f077b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:11.084362 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-37a431cd-f0c8-49c0-918a-228725f077b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:11.215849 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-37a431cd-f0c8-49c0-918a-228725f077b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:11.223119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-37a431cd-f0c8-49c0-918a-228725f077b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.154047 Jan 31 04:48:11.223682 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 234/447] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:11 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:11.320480 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-b8b15bab-ee2a-43b7-bc9c-9926a5ae5278 req-1544f2e0-6944-4ee3-99ca-4690cd2dd252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5466fd6b-2f35-4587-b100-45198d7240b1", "name": "network-vif-plugged", "status": "completed", "tag": "265e7198-6b49-481d-a84d-30c9eb1994ac"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:11.322145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:48:11.322145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:48:11.329384 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-b8b15bab-ee2a-43b7-bc9c-9926a5ae5278 req-1544f2e0-6944-4ee3-99ca-4690cd2dd252 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:11.329820 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-b8b15bab-ee2a-43b7-bc9c-9926a5ae5278 req-1544f2e0-6944-4ee3-99ca-4690cd2dd252 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:11.340337 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-b8b15bab-ee2a-43b7-bc9c-9926a5ae5278 req-1544f2e0-6944-4ee3-99ca-4690cd2dd252 service nova] Creating event network-vif-plugged:265e7198-6b49-481d-a84d-30c9eb1994ac for instance 5466fd6b-2f35-4587-b100-45198d7240b1 on hv-cinder-82660 Jan 31 04:48:11.345167 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-b8b15bab-ee2a-43b7-bc9c-9926a5ae5278 req-1544f2e0-6944-4ee3-99ca-4690cd2dd252 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029021 Jan 31 04:48:11.345738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 214/448] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:48:12.240030 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-845f17c8-ffd3-49a9-b46b-a87e8346cb08 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:12.240633 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-845f17c8-ffd3-49a9-b46b-a87e8346cb08 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:12.246709 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-845f17c8-ffd3-49a9-b46b-a87e8346cb08 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:12.247180 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-845f17c8-ffd3-49a9-b46b-a87e8346cb08 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:12.247946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-845f17c8-ffd3-49a9-b46b-a87e8346cb08 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:12.248405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-845f17c8-ffd3-49a9-b46b-a87e8346cb08 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:12.380667 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-845f17c8-ffd3-49a9-b46b-a87e8346cb08 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:12.387890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-845f17c8-ffd3-49a9-b46b-a87e8346cb08 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.152076 Jan 31 04:48:12.388440 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 235/449] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:12 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:13.405305 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-eb999ad9-d244-44c9-9da1-39b4e2aaf9b8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:13.405992 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-eb999ad9-d244-44c9-9da1-39b4e2aaf9b8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:13.413030 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eb999ad9-d244-44c9-9da1-39b4e2aaf9b8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:13.413478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eb999ad9-d244-44c9-9da1-39b4e2aaf9b8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:13.414246 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eb999ad9-d244-44c9-9da1-39b4e2aaf9b8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:13.414716 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eb999ad9-d244-44c9-9da1-39b4e2aaf9b8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:13.550474 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-eb999ad9-d244-44c9-9da1-39b4e2aaf9b8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:13.558376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-eb999ad9-d244-44c9-9da1-39b4e2aaf9b8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.157517 Jan 31 04:48:13.558962 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 215/450] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:13 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:14.575227 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8f18885a-1902-4f7b-8339-27a8b003d0fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:14.575771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8f18885a-1902-4f7b-8339-27a8b003d0fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:14.581851 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8f18885a-1902-4f7b-8339-27a8b003d0fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:14.582337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8f18885a-1902-4f7b-8339-27a8b003d0fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:14.583124 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8f18885a-1902-4f7b-8339-27a8b003d0fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:14.583556 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8f18885a-1902-4f7b-8339-27a8b003d0fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:14.713422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8f18885a-1902-4f7b-8339-27a8b003d0fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:14.720534 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8f18885a-1902-4f7b-8339-27a8b003d0fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.148972 Jan 31 04:48:14.721091 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 236/451] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:14 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:15.737316 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0c505e0b-a42c-478b-9a07-307eb4de9693 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:15.737915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0c505e0b-a42c-478b-9a07-307eb4de9693 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:15.744896 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0c505e0b-a42c-478b-9a07-307eb4de9693 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:15.745335 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0c505e0b-a42c-478b-9a07-307eb4de9693 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:15.746087 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0c505e0b-a42c-478b-9a07-307eb4de9693 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:15.746514 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0c505e0b-a42c-478b-9a07-307eb4de9693 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:15.880574 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0c505e0b-a42c-478b-9a07-307eb4de9693 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:15.887728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0c505e0b-a42c-478b-9a07-307eb4de9693 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.153972 Jan 31 04:48:15.888283 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 216/452] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:15 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:16.904275 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-92774aef-04cf-4f6c-a104-defea5b36411 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:16.904874 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-92774aef-04cf-4f6c-a104-defea5b36411 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:16.911388 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-92774aef-04cf-4f6c-a104-defea5b36411 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:16.911835 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-92774aef-04cf-4f6c-a104-defea5b36411 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:16.912595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-92774aef-04cf-4f6c-a104-defea5b36411 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:16.913020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-92774aef-04cf-4f6c-a104-defea5b36411 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:17.041526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-92774aef-04cf-4f6c-a104-defea5b36411 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:17.048822 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-92774aef-04cf-4f6c-a104-defea5b36411 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1317 microversion: 2.1 time: 0.148149 Jan 31 04:48:17.054352 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 237/453] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:16 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:18.069063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-68a211bb-9d11-473b-9c94-35e26df825fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:18.069631 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-68a211bb-9d11-473b-9c94-35e26df825fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:18.075835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-68a211bb-9d11-473b-9c94-35e26df825fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:18.076278 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-68a211bb-9d11-473b-9c94-35e26df825fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:18.077046 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-68a211bb-9d11-473b-9c94-35e26df825fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:18.077478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-68a211bb-9d11-473b-9c94-35e26df825fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:18.215074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-68a211bb-9d11-473b-9c94-35e26df825fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:18.222323 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-68a211bb-9d11-473b-9c94-35e26df825fd tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1507 microversion: 2.1 time: 0.157036 Jan 31 04:48:18.222971 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 217/454] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:18 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:19.266554 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8fefce90-2cb1-4e25-8b52-a1e68764758e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:19.267558 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8fefce90-2cb1-4e25-8b52-a1e68764758e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:19.274395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8fefce90-2cb1-4e25-8b52-a1e68764758e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:19.274862 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8fefce90-2cb1-4e25-8b52-a1e68764758e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:19.275628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8fefce90-2cb1-4e25-8b52-a1e68764758e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:19.276082 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8fefce90-2cb1-4e25-8b52-a1e68764758e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:19.298089 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-8fefce90-2cb1-4e25-8b52-a1e68764758e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lazy-loading 'flavor' on Instance uuid 81eea382-424b-4435-9241-e428592c98f3 {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:48:19.599069 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8fefce90-2cb1-4e25-8b52-a1e68764758e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/action" status: 200 len: 32 microversion: 2.1 time: 0.335988 Jan 31 04:48:19.599606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 238/455] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:48:19 2022] POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/action => generated 32 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 04:48:19.608247 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4afd2996-0109-440b-9b16-6c0172aa6d02 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:19.609032 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4afd2996-0109-440b-9b16-6c0172aa6d02 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:19.615967 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4afd2996-0109-440b-9b16-6c0172aa6d02 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:19.616390 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4afd2996-0109-440b-9b16-6c0172aa6d02 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:19.617152 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4afd2996-0109-440b-9b16-6c0172aa6d02 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:19.617578 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4afd2996-0109-440b-9b16-6c0172aa6d02 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:19.746058 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4afd2996-0109-440b-9b16-6c0172aa6d02 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:19.754219 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4afd2996-0109-440b-9b16-6c0172aa6d02 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.149579 Jan 31 04:48:19.754948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 218/456] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:19 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:20.772891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a3b4156e-73eb-4b1d-a57b-71b8f2be8ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:20.773592 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a3b4156e-73eb-4b1d-a57b-71b8f2be8ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:20.779526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3b4156e-73eb-4b1d-a57b-71b8f2be8ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:20.779972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3b4156e-73eb-4b1d-a57b-71b8f2be8ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:20.780750 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3b4156e-73eb-4b1d-a57b-71b8f2be8ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:20.781189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3b4156e-73eb-4b1d-a57b-71b8f2be8ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:20.919064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a3b4156e-73eb-4b1d-a57b-71b8f2be8ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:20.927380 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a3b4156e-73eb-4b1d-a57b-71b8f2be8ba7 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.159723 Jan 31 04:48:20.927931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 239/457] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:20 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:21.944289 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a0e9abde-6ab9-45d4-8363-d066442269ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:21.944916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a0e9abde-6ab9-45d4-8363-d066442269ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:21.951092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a0e9abde-6ab9-45d4-8363-d066442269ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:21.951535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a0e9abde-6ab9-45d4-8363-d066442269ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:21.952303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a0e9abde-6ab9-45d4-8363-d066442269ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:21.952730 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a0e9abde-6ab9-45d4-8363-d066442269ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:22.083799 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a0e9abde-6ab9-45d4-8363-d066442269ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:22.091649 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a0e9abde-6ab9-45d4-8363-d066442269ba tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.151711 Jan 31 04:48:22.092285 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 219/458] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:21 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:23.108405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-04e366cb-e48b-43a7-b4d2-9e86338f3a06 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:23.108916 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-04e366cb-e48b-43a7-b4d2-9e86338f3a06 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:23.115783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-04e366cb-e48b-43a7-b4d2-9e86338f3a06 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:23.116213 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-04e366cb-e48b-43a7-b4d2-9e86338f3a06 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:23.117000 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-04e366cb-e48b-43a7-b4d2-9e86338f3a06 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:23.117432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-04e366cb-e48b-43a7-b4d2-9e86338f3a06 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:23.257650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-04e366cb-e48b-43a7-b4d2-9e86338f3a06 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:23.265418 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-04e366cb-e48b-43a7-b4d2-9e86338f3a06 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.160752 Jan 31 04:48:23.265981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 240/459] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:23 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:23.950026 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f377979f-6ea4-4525-9cc4-8ace0f9226d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc0fc33e-863c-4064-a68c-4a92667ae9e1"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:23.951144 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f377979f-6ea4-4525-9cc4-8ace0f9226d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:23.958028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f377979f-6ea4-4525-9cc4-8ace0f9226d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:23.958662 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f377979f-6ea4-4525-9cc4-8ace0f9226d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:23.959469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f377979f-6ea4-4525-9cc4-8ace0f9226d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:23.959895 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f377979f-6ea4-4525-9cc4-8ace0f9226d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:24.281186 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6141502d-b368-41dc-a5ba-dd965823739c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:24.281793 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6141502d-b368-41dc-a5ba-dd965823739c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:24.288162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6141502d-b368-41dc-a5ba-dd965823739c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:24.288609 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6141502d-b368-41dc-a5ba-dd965823739c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:24.289380 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6141502d-b368-41dc-a5ba-dd965823739c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:24.289823 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6141502d-b368-41dc-a5ba-dd965823739c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:24.421243 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6141502d-b368-41dc-a5ba-dd965823739c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:24.429043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6141502d-b368-41dc-a5ba-dd965823739c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.151465 Jan 31 04:48:24.429625 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 241/460] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:24 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:24.644542 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f377979f-6ea4-4525-9cc4-8ace0f9226d9 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698003 Jan 31 04:48:24.645486 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 220/461] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:48:23 2022] POST /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:48:25.445268 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b552c090-4079-4116-8f1f-6c9cfeb0ae62 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:25.445872 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b552c090-4079-4116-8f1f-6c9cfeb0ae62 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:25.452888 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b552c090-4079-4116-8f1f-6c9cfeb0ae62 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:25.453411 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b552c090-4079-4116-8f1f-6c9cfeb0ae62 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:25.454227 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b552c090-4079-4116-8f1f-6c9cfeb0ae62 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:25.454665 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b552c090-4079-4116-8f1f-6c9cfeb0ae62 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:25.605441 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b552c090-4079-4116-8f1f-6c9cfeb0ae62 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:25.613990 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b552c090-4079-4116-8f1f-6c9cfeb0ae62 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.172327 Jan 31 04:48:25.614847 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 242/462] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:25 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:26.632277 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-293adb9b-c9ff-4576-a4bb-2fbf94c37a1b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:26.632965 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-293adb9b-c9ff-4576-a4bb-2fbf94c37a1b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:26.638877 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-293adb9b-c9ff-4576-a4bb-2fbf94c37a1b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:26.639321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-293adb9b-c9ff-4576-a4bb-2fbf94c37a1b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:26.640088 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-293adb9b-c9ff-4576-a4bb-2fbf94c37a1b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:26.640515 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-293adb9b-c9ff-4576-a4bb-2fbf94c37a1b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:26.777798 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-293adb9b-c9ff-4576-a4bb-2fbf94c37a1b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:26.786513 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-293adb9b-c9ff-4576-a4bb-2fbf94c37a1b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.159094 Jan 31 04:48:26.796492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 221/463] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:26 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:27.805263 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-105b3f2e-c469-4415-bb78-3c3210196c05 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:27.806011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-105b3f2e-c469-4415-bb78-3c3210196c05 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:27.815364 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-105b3f2e-c469-4415-bb78-3c3210196c05 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:27.816087 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-105b3f2e-c469-4415-bb78-3c3210196c05 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:27.818637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-105b3f2e-c469-4415-bb78-3c3210196c05 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:27.819238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-105b3f2e-c469-4415-bb78-3c3210196c05 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:27.958651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-105b3f2e-c469-4415-bb78-3c3210196c05 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:27.967405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-105b3f2e-c469-4415-bb78-3c3210196c05 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.167601 Jan 31 04:48:27.967973 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 243/464] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:27 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:28.984565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cbe1a9b9-0974-41a4-b5f5-4f18acb9b9fd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:28.985170 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cbe1a9b9-0974-41a4-b5f5-4f18acb9b9fd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:28.992381 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cbe1a9b9-0974-41a4-b5f5-4f18acb9b9fd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:28.992820 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cbe1a9b9-0974-41a4-b5f5-4f18acb9b9fd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:28.993594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cbe1a9b9-0974-41a4-b5f5-4f18acb9b9fd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:28.994021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cbe1a9b9-0974-41a4-b5f5-4f18acb9b9fd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:29.128663 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cbe1a9b9-0974-41a4-b5f5-4f18acb9b9fd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:29.136714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cbe1a9b9-0974-41a4-b5f5-4f18acb9b9fd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.155888 Jan 31 04:48:29.140782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 222/465] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:28 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:30.153541 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c5e69340-7821-4d0c-8019-130e979d7e92 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:30.154147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c5e69340-7821-4d0c-8019-130e979d7e92 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:30.160428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c5e69340-7821-4d0c-8019-130e979d7e92 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:30.163189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c5e69340-7821-4d0c-8019-130e979d7e92 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:30.163189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c5e69340-7821-4d0c-8019-130e979d7e92 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:30.163189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c5e69340-7821-4d0c-8019-130e979d7e92 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:30.304286 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c5e69340-7821-4d0c-8019-130e979d7e92 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:30.312043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c5e69340-7821-4d0c-8019-130e979d7e92 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.162282 Jan 31 04:48:30.312609 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 244/466] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:30 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:31.328630 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c062a6cf-008c-4d4e-90c9-e77d030fde66 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:31.329147 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c062a6cf-008c-4d4e-90c9-e77d030fde66 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:31.336475 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c062a6cf-008c-4d4e-90c9-e77d030fde66 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:31.341467 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c062a6cf-008c-4d4e-90c9-e77d030fde66 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:31.341467 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c062a6cf-008c-4d4e-90c9-e77d030fde66 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:31.341467 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c062a6cf-008c-4d4e-90c9-e77d030fde66 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:31.473944 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c062a6cf-008c-4d4e-90c9-e77d030fde66 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:31.482375 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c062a6cf-008c-4d4e-90c9-e77d030fde66 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.157456 Jan 31 04:48:31.482970 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 223/467] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:31 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:32.498925 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e2444534-6d80-4809-a652-4059da5caba6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:32.499534 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e2444534-6d80-4809-a652-4059da5caba6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:32.506111 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e2444534-6d80-4809-a652-4059da5caba6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:32.506567 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e2444534-6d80-4809-a652-4059da5caba6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:32.507361 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e2444534-6d80-4809-a652-4059da5caba6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:32.507793 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e2444534-6d80-4809-a652-4059da5caba6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:32.635367 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e2444534-6d80-4809-a652-4059da5caba6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:32.642919 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e2444534-6d80-4809-a652-4059da5caba6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.147606 Jan 31 04:48:32.643477 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 245/468] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:32 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:33.659269 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8a956b31-4830-4b72-99d4-264e70948faf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:33.659905 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8a956b31-4830-4b72-99d4-264e70948faf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:33.666055 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a956b31-4830-4b72-99d4-264e70948faf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:33.666500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a956b31-4830-4b72-99d4-264e70948faf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:33.667338 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a956b31-4830-4b72-99d4-264e70948faf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:33.667771 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8a956b31-4830-4b72-99d4-264e70948faf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:33.799091 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8a956b31-4830-4b72-99d4-264e70948faf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:33.807296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8a956b31-4830-4b72-99d4-264e70948faf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.151603 Jan 31 04:48:33.807857 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 224/469] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:33 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:34.823526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-fd76dd6b-5d50-4476-bd24-0ae6d1d2ff36 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:34.824134 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-fd76dd6b-5d50-4476-bd24-0ae6d1d2ff36 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:34.830279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd76dd6b-5d50-4476-bd24-0ae6d1d2ff36 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:34.830722 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd76dd6b-5d50-4476-bd24-0ae6d1d2ff36 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:34.831511 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd76dd6b-5d50-4476-bd24-0ae6d1d2ff36 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:34.831942 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd76dd6b-5d50-4476-bd24-0ae6d1d2ff36 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:34.966302 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fd76dd6b-5d50-4476-bd24-0ae6d1d2ff36 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:34.973976 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-fd76dd6b-5d50-4476-bd24-0ae6d1d2ff36 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.154040 Jan 31 04:48:34.975513 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 246/470] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:34 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:36.001586 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7c59fc4c-bc11-4bea-b977-2f6d1b5f2f57 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:36.007516 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7c59fc4c-bc11-4bea-b977-2f6d1b5f2f57 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:36.015106 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7c59fc4c-bc11-4bea-b977-2f6d1b5f2f57 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:36.015841 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7c59fc4c-bc11-4bea-b977-2f6d1b5f2f57 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:36.017058 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7c59fc4c-bc11-4bea-b977-2f6d1b5f2f57 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:36.017680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7c59fc4c-bc11-4bea-b977-2f6d1b5f2f57 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:36.174483 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7c59fc4c-bc11-4bea-b977-2f6d1b5f2f57 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:36.182866 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7c59fc4c-bc11-4bea-b977-2f6d1b5f2f57 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.186265 Jan 31 04:48:36.183433 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 225/471] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:35 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:36.441821 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc0fc33e-863c-4064-a68c-4a92667ae9e1"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:36.443441 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:36.449595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:36.450030 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:36.450803 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:36.451233 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:36.526868 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] HTTP exception thrown: Invalid volume: volume bc0fc33e-863c-4064-a68c-4a92667ae9e1 is already attached to instances: 5466fd6b-2f35-4587-b100-45198d7240b1 Jan 31 04:48:36.527491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Returning 400 to user: Invalid volume: volume bc0fc33e-863c-4064-a68c-4a92667ae9e1 is already attached to instances: 5466fd6b-2f35-4587-b100-45198d7240b1 {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:48:36.528355 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-adc9ca72-ffc6-47fa-9772-ec2d188dfa92 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090386 Jan 31 04:48:36.533905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 247/472] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:48:36 2022] POST /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 04:48:36.585930 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ab7c2408-bc59-479c-b83d-49c40da99e43 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:36.590015 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ab7c2408-bc59-479c-b83d-49c40da99e43 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:36.592039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ab7c2408-bc59-479c-b83d-49c40da99e43 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:36.592480 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ab7c2408-bc59-479c-b83d-49c40da99e43 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:36.593238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ab7c2408-bc59-479c-b83d-49c40da99e43 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:36.593663 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ab7c2408-bc59-479c-b83d-49c40da99e43 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:36.714990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-ab7c2408-bc59-479c-b83d-49c40da99e43 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lazy-loading 'services' on Instance uuid 5466fd6b-2f35-4587-b100-45198d7240b1 {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:48:36.982762 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ab7c2408-bc59-479c-b83d-49c40da99e43 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments/bc0fc33e-863c-4064-a68c-4a92667ae9e1" status: 202 len: 0 microversion: 2.1 time: 0.400922 Jan 31 04:48:36.983364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 226/473] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:48:36 2022] DELETE /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments/bc0fc33e-863c-4064-a68c-4a92667ae9e1 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:48:36.994891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5dc47fe6-d0e9-45d8-b352-35aed90fd333 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:36.995801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5dc47fe6-d0e9-45d8-b352-35aed90fd333 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:37.002214 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5dc47fe6-d0e9-45d8-b352-35aed90fd333 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:37.002652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5dc47fe6-d0e9-45d8-b352-35aed90fd333 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:37.003695 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5dc47fe6-d0e9-45d8-b352-35aed90fd333 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:37.004203 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5dc47fe6-d0e9-45d8-b352-35aed90fd333 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:37.033515 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5dc47fe6-d0e9-45d8-b352-35aed90fd333 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Jan 31 04:48:37.034106 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 248/474] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:48:36 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:48:37.200714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-73fc01de-89a0-4914-a44b-110b0919ffe3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:37.201417 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-73fc01de-89a0-4914-a44b-110b0919ffe3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:37.207747 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-73fc01de-89a0-4914-a44b-110b0919ffe3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:37.208223 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-73fc01de-89a0-4914-a44b-110b0919ffe3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:37.209753 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-73fc01de-89a0-4914-a44b-110b0919ffe3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:37.210200 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-73fc01de-89a0-4914-a44b-110b0919ffe3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:37.341769 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-73fc01de-89a0-4914-a44b-110b0919ffe3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:37.349548 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-73fc01de-89a0-4914-a44b-110b0919ffe3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.153253 Jan 31 04:48:37.350103 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 227/475] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:37 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:38.045143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7fa000e0-78cb-4be4-84f4-7f853a5596fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:38.046078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7fa000e0-78cb-4be4-84f4-7f853a5596fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:38.052355 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7fa000e0-78cb-4be4-84f4-7f853a5596fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:38.052855 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7fa000e0-78cb-4be4-84f4-7f853a5596fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:38.053632 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7fa000e0-78cb-4be4-84f4-7f853a5596fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:38.054067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7fa000e0-78cb-4be4-84f4-7f853a5596fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:38.082083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7fa000e0-78cb-4be4-84f4-7f853a5596fa tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040624 Jan 31 04:48:38.082645 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 249/476] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:48:38 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:48:38.366194 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f877d99d-90c1-4ec2-9272-254b3fc46659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:38.368988 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f877d99d-90c1-4ec2-9272-254b3fc46659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:38.373303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f877d99d-90c1-4ec2-9272-254b3fc46659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:38.373725 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f877d99d-90c1-4ec2-9272-254b3fc46659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:38.374526 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f877d99d-90c1-4ec2-9272-254b3fc46659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:38.375025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f877d99d-90c1-4ec2-9272-254b3fc46659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:38.513282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f877d99d-90c1-4ec2-9272-254b3fc46659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:38.521576 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f877d99d-90c1-4ec2-9272-254b3fc46659 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.158506 Jan 31 04:48:38.522238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 228/477] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:38 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:39.094008 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-374bb0d3-14c1-433d-89a6-41d8e9b9a187 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:39.094957 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-374bb0d3-14c1-433d-89a6-41d8e9b9a187 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:39.101184 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-374bb0d3-14c1-433d-89a6-41d8e9b9a187 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:39.101621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-374bb0d3-14c1-433d-89a6-41d8e9b9a187 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:39.102380 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-374bb0d3-14c1-433d-89a6-41d8e9b9a187 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:39.102817 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-374bb0d3-14c1-433d-89a6-41d8e9b9a187 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:39.132736 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-374bb0d3-14c1-433d-89a6-41d8e9b9a187 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042728 Jan 31 04:48:39.133273 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 250/478] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:48:39 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 04:48:39.295350 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1729810053", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "58128fc4-bc4f-417c-908e-383736354847"}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:39.343536 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] validate_networks() for [('58128fc4-bc4f-417c-908e-383736354847', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:48:39.537546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e8fe9d49-ffe8-4f30-b9a7-15d335df0486 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:39.538284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e8fe9d49-ffe8-4f30-b9a7-15d335df0486 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:39.544447 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e8fe9d49-ffe8-4f30-b9a7-15d335df0486 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:39.544962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e8fe9d49-ffe8-4f30-b9a7-15d335df0486 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:39.545892 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e8fe9d49-ffe8-4f30-b9a7-15d335df0486 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:39.546374 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e8fe9d49-ffe8-4f30-b9a7-15d335df0486 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:39.686576 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e8fe9d49-ffe8-4f30-b9a7-15d335df0486 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:39.694680 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e8fe9d49-ffe8-4f30-b9a7-15d335df0486 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.160672 Jan 31 04:48:39.703591 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 251/479] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:39 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:39.722149 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:48:39.724623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:48:39.725089 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:48:39.725491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:48:39.725892 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:48:39.735082 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:39.735465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:39.737876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:39.738110 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:39.754878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Getting quotas for project 41828fbc91c740cfbec65e04e92a4ecc. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:48:39.758891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Getting quotas for user 6a6f7f126c2a4cbe80f029f352c4cafd and project 41828fbc91c740cfbec65e04e92a4ecc. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:48:39.769824 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:48:39.772777 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:48:39.859547 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8f8c3dba-dcd2-47dc-9198-3ba6625e624c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573090 Jan 31 04:48:39.860185 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 229/480] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:48:39.869993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ed8257e6-6a25-4641-ba32-5a11522e2880 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:39.870612 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ed8257e6-6a25-4641-ba32-5a11522e2880 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:39.923143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ed8257e6-6a25-4641-ba32-5a11522e2880 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:39.929512 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ed8257e6-6a25-4641-ba32-5a11522e2880 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1218 microversion: 2.1 time: 0.063159 Jan 31 04:48:39.930074 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 252/481] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:39 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:40.712484 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-50ad096e-d2f6-4b9d-9abf-e9eee68f15d6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:40.713132 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-50ad096e-d2f6-4b9d-9abf-e9eee68f15d6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:40.719575 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50ad096e-d2f6-4b9d-9abf-e9eee68f15d6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:40.722530 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50ad096e-d2f6-4b9d-9abf-e9eee68f15d6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:40.722530 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50ad096e-d2f6-4b9d-9abf-e9eee68f15d6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:40.722530 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50ad096e-d2f6-4b9d-9abf-e9eee68f15d6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:40.857297 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-50ad096e-d2f6-4b9d-9abf-e9eee68f15d6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:40.865040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-50ad096e-d2f6-4b9d-9abf-e9eee68f15d6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.157699 Jan 31 04:48:40.865738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 230/482] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:40 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:40.947091 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-05f648dd-2bcc-4d38-b21f-a2196b2dda2f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:40.947793 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-05f648dd-2bcc-4d38-b21f-a2196b2dda2f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:40.954354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-05f648dd-2bcc-4d38-b21f-a2196b2dda2f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:40.954818 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-05f648dd-2bcc-4d38-b21f-a2196b2dda2f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:40.955613 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-05f648dd-2bcc-4d38-b21f-a2196b2dda2f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:40.956050 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-05f648dd-2bcc-4d38-b21f-a2196b2dda2f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:41.019574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-05f648dd-2bcc-4d38-b21f-a2196b2dda2f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:41.026748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-05f648dd-2bcc-4d38-b21f-a2196b2dda2f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1222 microversion: 2.1 time: 0.083868 Jan 31 04:48:41.027399 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 253/483] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:40 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:41.881363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-46e01cde-49b9-42ca-a281-4d8933d14657 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:41.882041 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-46e01cde-49b9-42ca-a281-4d8933d14657 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:41.888464 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46e01cde-49b9-42ca-a281-4d8933d14657 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:41.888858 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46e01cde-49b9-42ca-a281-4d8933d14657 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:41.889641 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46e01cde-49b9-42ca-a281-4d8933d14657 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:41.890083 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46e01cde-49b9-42ca-a281-4d8933d14657 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:42.035836 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-46e01cde-49b9-42ca-a281-4d8933d14657 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:42.044409 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b6bfcf75-0ab8-458a-bd4f-225c44f4f1b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:42.044897 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-46e01cde-49b9-42ca-a281-4d8933d14657 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.167116 Jan 31 04:48:42.045020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b6bfcf75-0ab8-458a-bd4f-225c44f4f1b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:42.045128 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 231/484] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:41 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:42.055692 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6bfcf75-0ab8-458a-bd4f-225c44f4f1b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:42.056072 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6bfcf75-0ab8-458a-bd4f-225c44f4f1b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:42.056883 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6bfcf75-0ab8-458a-bd4f-225c44f4f1b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:42.057315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6bfcf75-0ab8-458a-bd4f-225c44f4f1b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:42.118431 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b6bfcf75-0ab8-458a-bd4f-225c44f4f1b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:42.125571 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b6bfcf75-0ab8-458a-bd4f-225c44f4f1b4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1270 microversion: 2.1 time: 0.084673 Jan 31 04:48:42.126136 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 254/485] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:42 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:43.061484 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9f2b800c-4ca1-4ad8-9c6c-55077d909fe9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:43.062734 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9f2b800c-4ca1-4ad8-9c6c-55077d909fe9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:43.071689 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9f2b800c-4ca1-4ad8-9c6c-55077d909fe9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:43.075317 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9f2b800c-4ca1-4ad8-9c6c-55077d909fe9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:43.075317 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9f2b800c-4ca1-4ad8-9c6c-55077d909fe9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:43.075317 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9f2b800c-4ca1-4ad8-9c6c-55077d909fe9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:43.143646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4849ccaa-ea5c-4e3f-ba0d-efddb6b076bb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:43.144256 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4849ccaa-ea5c-4e3f-ba0d-efddb6b076bb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:43.151414 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4849ccaa-ea5c-4e3f-ba0d-efddb6b076bb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:43.151866 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4849ccaa-ea5c-4e3f-ba0d-efddb6b076bb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:43.152644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4849ccaa-ea5c-4e3f-ba0d-efddb6b076bb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:43.153078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4849ccaa-ea5c-4e3f-ba0d-efddb6b076bb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:43.218552 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9f2b800c-4ca1-4ad8-9c6c-55077d909fe9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:43.228174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9f2b800c-4ca1-4ad8-9c6c-55077d909fe9 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.170575 Jan 31 04:48:43.230071 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 232/486] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:43 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:43.299046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4849ccaa-ea5c-4e3f-ba0d-efddb6b076bb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:43.308848 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4849ccaa-ea5c-4e3f-ba0d-efddb6b076bb tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.168694 Jan 31 04:48:43.309529 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 255/487] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:43 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:44.249304 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0cc8a3df-c357-46e5-8989-13a4c91d0596 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:44.249910 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0cc8a3df-c357-46e5-8989-13a4c91d0596 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:44.256248 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cc8a3df-c357-46e5-8989-13a4c91d0596 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:44.256756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cc8a3df-c357-46e5-8989-13a4c91d0596 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:44.257646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cc8a3df-c357-46e5-8989-13a4c91d0596 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:44.258101 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cc8a3df-c357-46e5-8989-13a4c91d0596 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:44.326291 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b6f9512d-b321-4a2a-a691-fcf72f096af0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:44.326924 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b6f9512d-b321-4a2a-a691-fcf72f096af0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:44.334117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6f9512d-b321-4a2a-a691-fcf72f096af0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:44.334117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6f9512d-b321-4a2a-a691-fcf72f096af0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:44.335614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6f9512d-b321-4a2a-a691-fcf72f096af0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:44.335614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6f9512d-b321-4a2a-a691-fcf72f096af0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:44.392249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0cc8a3df-c357-46e5-8989-13a4c91d0596 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:44.400520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0cc8a3df-c357-46e5-8989-13a4c91d0596 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.154923 Jan 31 04:48:44.401130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 233/488] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:44 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:44.551210 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b6f9512d-b321-4a2a-a691-fcf72f096af0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:44.558501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b6f9512d-b321-4a2a-a691-fcf72f096af0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.236183 Jan 31 04:48:44.559090 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 256/489] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:44 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:45.417715 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d1767a6d-2415-40af-bb15-277f21968f7f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:45.418585 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d1767a6d-2415-40af-bb15-277f21968f7f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:45.425005 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d1767a6d-2415-40af-bb15-277f21968f7f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:45.425591 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d1767a6d-2415-40af-bb15-277f21968f7f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:45.426475 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d1767a6d-2415-40af-bb15-277f21968f7f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:45.427019 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d1767a6d-2415-40af-bb15-277f21968f7f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:45.575191 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a91f8bf7-113f-41c1-8d97-cbf66a974721 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:45.575904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a91f8bf7-113f-41c1-8d97-cbf66a974721 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:45.581593 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d1767a6d-2415-40af-bb15-277f21968f7f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:45.590700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d1767a6d-2415-40af-bb15-277f21968f7f tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.176943 Jan 31 04:48:45.591513 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 234/490] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:45 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:45.592235 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a91f8bf7-113f-41c1-8d97-cbf66a974721 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:45.592758 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a91f8bf7-113f-41c1-8d97-cbf66a974721 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:45.593931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a91f8bf7-113f-41c1-8d97-cbf66a974721 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:45.594457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a91f8bf7-113f-41c1-8d97-cbf66a974721 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:45.786395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a91f8bf7-113f-41c1-8d97-cbf66a974721 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:45.794095 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a91f8bf7-113f-41c1-8d97-cbf66a974721 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.222451 Jan 31 04:48:45.794660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 257/491] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:45 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:45.868743 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-a5a5026d-8302-4d6b-894e-cab4b5381d91 req-d5fc75cc-f50b-45de-aec6-298e91a2f437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caeb7284-3cc9-4e25-8268-f4aa7eb66ab9", "tag": "482834c2-7b2c-4fdc-aec2-6bf0968d1671"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:45.870307 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:48:45.870307 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:48:45.877614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-a5a5026d-8302-4d6b-894e-cab4b5381d91 req-d5fc75cc-f50b-45de-aec6-298e91a2f437 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:45.878308 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-a5a5026d-8302-4d6b-894e-cab4b5381d91 req-d5fc75cc-f50b-45de-aec6-298e91a2f437 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:45.889295 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-a5a5026d-8302-4d6b-894e-cab4b5381d91 req-d5fc75cc-f50b-45de-aec6-298e91a2f437 service nova] Creating event network-changed:482834c2-7b2c-4fdc-aec2-6bf0968d1671 for instance caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 on hv-cinder-82660 Jan 31 04:48:45.894056 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-a5a5026d-8302-4d6b-894e-cab4b5381d91 req-d5fc75cc-f50b-45de-aec6-298e91a2f437 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029283 Jan 31 04:48:45.894603 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 235/492] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:48:46.607302 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b969ca21-2917-4201-a7e2-8ecf164cac2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:46.607904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b969ca21-2917-4201-a7e2-8ecf164cac2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:46.614088 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b969ca21-2917-4201-a7e2-8ecf164cac2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:46.614523 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b969ca21-2917-4201-a7e2-8ecf164cac2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:46.615321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b969ca21-2917-4201-a7e2-8ecf164cac2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:46.615779 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b969ca21-2917-4201-a7e2-8ecf164cac2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:46.779694 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b969ca21-2917-4201-a7e2-8ecf164cac2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:46.787333 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b969ca21-2917-4201-a7e2-8ecf164cac2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.183681 Jan 31 04:48:46.787944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 258/493] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:46 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:46.812145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7b72815e-552c-45ac-bb8b-fac823547b1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:46.812856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7b72815e-552c-45ac-bb8b-fac823547b1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:46.819535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7b72815e-552c-45ac-bb8b-fac823547b1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:46.820107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7b72815e-552c-45ac-bb8b-fac823547b1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:46.821073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7b72815e-552c-45ac-bb8b-fac823547b1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:46.821506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7b72815e-552c-45ac-bb8b-fac823547b1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:46.953953 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7b72815e-552c-45ac-bb8b-fac823547b1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:46.961810 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7b72815e-552c-45ac-bb8b-fac823547b1d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.154085 Jan 31 04:48:46.962377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 236/494] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:46 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:47.734421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 04:48:47.734985 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 04:48:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 04:48:47.804491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-db236813-7e94-4271-ab29-511ce562d4f3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:47.805087 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-db236813-7e94-4271-ab29-511ce562d4f3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:47.811509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-db236813-7e94-4271-ab29-511ce562d4f3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:47.811952 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-db236813-7e94-4271-ab29-511ce562d4f3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:47.812740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-db236813-7e94-4271-ab29-511ce562d4f3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:47.813167 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-db236813-7e94-4271-ab29-511ce562d4f3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:47.947645 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-db236813-7e94-4271-ab29-511ce562d4f3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:47.955324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-db236813-7e94-4271-ab29-511ce562d4f3 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.155199 Jan 31 04:48:47.955877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 259/495] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:47 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:47.978169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0a11c740-77bd-4617-a1d9-3bfd6cfa0c51 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:47.978907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0a11c740-77bd-4617-a1d9-3bfd6cfa0c51 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:47.989558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0a11c740-77bd-4617-a1d9-3bfd6cfa0c51 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:47.989558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0a11c740-77bd-4617-a1d9-3bfd6cfa0c51 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:47.989558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0a11c740-77bd-4617-a1d9-3bfd6cfa0c51 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:47.989558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0a11c740-77bd-4617-a1d9-3bfd6cfa0c51 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:48.128377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0a11c740-77bd-4617-a1d9-3bfd6cfa0c51 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:48.135784 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0a11c740-77bd-4617-a1d9-3bfd6cfa0c51 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.161216 Jan 31 04:48:48.136344 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 237/496] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:47 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:48.236634 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1004709812", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "c4477f49-ebf4-4e7b-8c85-2d53d2a5b898"}]}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:48.286405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] validate_networks() for [('c4477f49-ebf4-4e7b-8c85-2d53d2a5b898', None, None, None, None, None)] {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:48:48.624822 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:48:48.625279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:48:48.625745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:48:48.626145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:48:48.626547 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:48:48.635593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:48.636028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:48.636818 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:48.637244 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:48.654218 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Getting quotas for project 30fced24126f40ac94f018df7c960a15. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:48:48.658119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Getting quotas for user e7557280caf846d6bdd96d80e1d28333 and project 30fced24126f40ac94f018df7c960a15. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:48:48.669212 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:48:48.671491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:48:48.804068 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8bb9312d-b938-46df-87e6-88e49de90ea5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570827 Jan 31 04:48:48.804696 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 260/497] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:48:48.814618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7afe1508-5698-4a02-bed0-3cae61678db7 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:48.815380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7afe1508-5698-4a02-bed0-3cae61678db7 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:48.866186 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7afe1508-5698-4a02-bed0-3cae61678db7 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:48.872608 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7afe1508-5698-4a02-bed0-3cae61678db7 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1214 microversion: 2.1 time: 0.061700 Jan 31 04:48:48.873177 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 238/498] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:48 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1214 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:48.972318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b7257a41-43bc-4f50-83c9-5896985a424d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:48.972942 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b7257a41-43bc-4f50-83c9-5896985a424d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:48.979407 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b7257a41-43bc-4f50-83c9-5896985a424d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:48.979851 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b7257a41-43bc-4f50-83c9-5896985a424d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:48.980636 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b7257a41-43bc-4f50-83c9-5896985a424d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:48.981115 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b7257a41-43bc-4f50-83c9-5896985a424d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:49.117653 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b7257a41-43bc-4f50-83c9-5896985a424d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:49.125701 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b7257a41-43bc-4f50-83c9-5896985a424d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.157199 Jan 31 04:48:49.126219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 261/499] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:48 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:49.153097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-809b7067-6ebb-4235-a986-24d4dcf741c8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:49.153700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-809b7067-6ebb-4235-a986-24d4dcf741c8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:49.159883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-809b7067-6ebb-4235-a986-24d4dcf741c8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:49.160320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-809b7067-6ebb-4235-a986-24d4dcf741c8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:49.161073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-809b7067-6ebb-4235-a986-24d4dcf741c8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:49.161497 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-809b7067-6ebb-4235-a986-24d4dcf741c8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:49.293007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-809b7067-6ebb-4235-a986-24d4dcf741c8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:49.300218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-809b7067-6ebb-4235-a986-24d4dcf741c8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.150785 Jan 31 04:48:49.301014 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 239/500] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:49 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:49.889145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a345792a-1dfc-4662-a591-0aaf1b192f5a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:49.889751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a345792a-1dfc-4662-a591-0aaf1b192f5a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:49.895693 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a345792a-1dfc-4662-a591-0aaf1b192f5a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:49.896135 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a345792a-1dfc-4662-a591-0aaf1b192f5a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:49.896896 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a345792a-1dfc-4662-a591-0aaf1b192f5a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:49.897330 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a345792a-1dfc-4662-a591-0aaf1b192f5a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:49.955126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a345792a-1dfc-4662-a591-0aaf1b192f5a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:49.962326 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a345792a-1dfc-4662-a591-0aaf1b192f5a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1218 microversion: 2.1 time: 0.076839 Jan 31 04:48:49.962900 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 262/501] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:49 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:50.143007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-59e76434-c0c4-4af8-993a-174dded44800 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:50.143606 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-59e76434-c0c4-4af8-993a-174dded44800 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:50.149862 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59e76434-c0c4-4af8-993a-174dded44800 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:50.150307 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59e76434-c0c4-4af8-993a-174dded44800 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:50.151085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59e76434-c0c4-4af8-993a-174dded44800 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:50.151514 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59e76434-c0c4-4af8-993a-174dded44800 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:50.283101 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-59e76434-c0c4-4af8-993a-174dded44800 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:50.291491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-59e76434-c0c4-4af8-993a-174dded44800 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.152030 Jan 31 04:48:50.292050 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 240/502] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:50 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:50.318310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9e731799-c30a-478a-8f6b-08988d2bd5d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:50.319272 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9e731799-c30a-478a-8f6b-08988d2bd5d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:50.325554 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9e731799-c30a-478a-8f6b-08988d2bd5d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:50.325991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9e731799-c30a-478a-8f6b-08988d2bd5d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:50.326749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9e731799-c30a-478a-8f6b-08988d2bd5d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:50.327198 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9e731799-c30a-478a-8f6b-08988d2bd5d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:50.462432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9e731799-c30a-478a-8f6b-08988d2bd5d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:50.469901 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9e731799-c30a-478a-8f6b-08988d2bd5d1 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.155347 Jan 31 04:48:50.470454 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 263/503] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:50 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:50.981262 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-104a97ca-95b6-4813-84bb-ec4b76fd6ffb tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:50.981869 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-104a97ca-95b6-4813-84bb-ec4b76fd6ffb tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:50.987670 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-104a97ca-95b6-4813-84bb-ec4b76fd6ffb tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:50.988111 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-104a97ca-95b6-4813-84bb-ec4b76fd6ffb tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:50.988873 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-104a97ca-95b6-4813-84bb-ec4b76fd6ffb tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:50.989302 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-104a97ca-95b6-4813-84bb-ec4b76fd6ffb tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:51.047342 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-104a97ca-95b6-4813-84bb-ec4b76fd6ffb tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:51.055019 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-104a97ca-95b6-4813-84bb-ec4b76fd6ffb tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1266 microversion: 2.1 time: 0.077305 Jan 31 04:48:51.055569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 241/504] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:50 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:51.309095 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-40bbf97f-9219-4aac-8a9f-206d1827f7d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:51.309634 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-40bbf97f-9219-4aac-8a9f-206d1827f7d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:51.315652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-40bbf97f-9219-4aac-8a9f-206d1827f7d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:51.316103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-40bbf97f-9219-4aac-8a9f-206d1827f7d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:51.316885 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-40bbf97f-9219-4aac-8a9f-206d1827f7d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:51.317320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-40bbf97f-9219-4aac-8a9f-206d1827f7d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:51.465391 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-40bbf97f-9219-4aac-8a9f-206d1827f7d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:51.473225 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-40bbf97f-9219-4aac-8a9f-206d1827f7d5 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1567 microversion: 2.1 time: 0.168718 Jan 31 04:48:51.473815 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 264/505] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:51 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:51.486319 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-71a696fb-ba21-4fe3-a34f-03d9cc5ebd49 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:51.487363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-71a696fb-ba21-4fe3-a34f-03d9cc5ebd49 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:51.493308 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71a696fb-ba21-4fe3-a34f-03d9cc5ebd49 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:51.493780 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71a696fb-ba21-4fe3-a34f-03d9cc5ebd49 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:51.494561 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71a696fb-ba21-4fe3-a34f-03d9cc5ebd49 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:51.495023 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71a696fb-ba21-4fe3-a34f-03d9cc5ebd49 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:51.639803 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-71a696fb-ba21-4fe3-a34f-03d9cc5ebd49 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:51.647502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-71a696fb-ba21-4fe3-a34f-03d9cc5ebd49 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.164703 Jan 31 04:48:51.648587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 242/506] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:51 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:52.071492 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-36cb6fd1-ddef-4893-a817-b23528a5746a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:52.072099 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-36cb6fd1-ddef-4893-a817-b23528a5746a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:52.077920 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36cb6fd1-ddef-4893-a817-b23528a5746a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.078369 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36cb6fd1-ddef-4893-a817-b23528a5746a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.079185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36cb6fd1-ddef-4893-a817-b23528a5746a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.079627 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36cb6fd1-ddef-4893-a817-b23528a5746a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.141430 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-36cb6fd1-ddef-4893-a817-b23528a5746a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:52.148906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-36cb6fd1-ddef-4893-a817-b23528a5746a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1272 microversion: 2.1 time: 0.081025 Jan 31 04:48:52.149341 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 265/507] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:52 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:52.490272 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f1e0290a-19a6-4676-992e-c5e1166693cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:52.490911 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f1e0290a-19a6-4676-992e-c5e1166693cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:52.497401 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1e0290a-19a6-4676-992e-c5e1166693cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.497844 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1e0290a-19a6-4676-992e-c5e1166693cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.498631 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1e0290a-19a6-4676-992e-c5e1166693cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.499097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1e0290a-19a6-4676-992e-c5e1166693cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.638522 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f1e0290a-19a6-4676-992e-c5e1166693cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:52.650199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f1e0290a-19a6-4676-992e-c5e1166693cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1547 microversion: 2.1 time: 0.162938 Jan 31 04:48:52.650983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 243/508] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:52 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:52.665357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c1953495-3dc5-4109-8349-553d12424cec tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:52.666652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c1953495-3dc5-4109-8349-553d12424cec tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:52.680940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c1953495-3dc5-4109-8349-553d12424cec tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.680940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c1953495-3dc5-4109-8349-553d12424cec tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.680940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c1953495-3dc5-4109-8349-553d12424cec tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.681211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:52.681211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:52.683382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c1953495-3dc5-4109-8349-553d12424cec tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.690660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.695497 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.695497 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.695497 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.773396 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] HTTP exception thrown: Cannot 'detach_volume' instance 81eea382-424b-4435-9241-e428592c98f3 while it is in vm_state rescued Jan 31 04:48:52.773986 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Returning 409 to user: Cannot 'detach_volume' instance 81eea382-424b-4435-9241-e428592c98f3 while it is in vm_state rescued {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:48:52.774816 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-12ccbc5b-ba63-421c-987d-e65587d0006a tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "DELETE /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments/7a5e1961-5119-4c02-9c92-76599553712a" status: 409 len: 152 microversion: 2.1 time: 0.103820 Jan 31 04:48:52.775368 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 244/509] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:48:52 2022] DELETE /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments/7a5e1961-5119-4c02-9c92-76599553712a => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 31 04:48:52.783398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-699747ea-5244-483f-83d7-4d6138d4683c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:52.783920 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-699747ea-5244-483f-83d7-4d6138d4683c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:52.790403 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-699747ea-5244-483f-83d7-4d6138d4683c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.790856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-699747ea-5244-483f-83d7-4d6138d4683c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.791626 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-699747ea-5244-483f-83d7-4d6138d4683c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.792049 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-699747ea-5244-483f-83d7-4d6138d4683c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.859112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c1953495-3dc5-4109-8349-553d12424cec tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:52.866336 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c1953495-3dc5-4109-8349-553d12424cec tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.205478 Jan 31 04:48:52.867608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 266/510] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:52 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:52.964847 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-699747ea-5244-483f-83d7-4d6138d4683c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/action" status: 202 len: 0 microversion: 2.1 time: 0.184259 Jan 31 04:48:52.964847 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 245/511] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:48:52 2022] POST /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 04:48:52.972622 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ec30ab72-d1bd-409a-b6dd-972268875ac0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:52.973504 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ec30ab72-d1bd-409a-b6dd-972268875ac0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:52.980057 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec30ab72-d1bd-409a-b6dd-972268875ac0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.980497 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec30ab72-d1bd-409a-b6dd-972268875ac0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:52.981425 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec30ab72-d1bd-409a-b6dd-972268875ac0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:52.981840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec30ab72-d1bd-409a-b6dd-972268875ac0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:53.142054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ec30ab72-d1bd-409a-b6dd-972268875ac0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:53.151877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ec30ab72-d1bd-409a-b6dd-972268875ac0 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1555 microversion: 2.1 time: 0.182828 Jan 31 04:48:53.152775 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 267/512] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:52 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:53.167762 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bd4b8e36-36e7-4f5e-ad26-10d801dbfd0a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:53.168176 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bd4b8e36-36e7-4f5e-ad26-10d801dbfd0a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:53.175125 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd4b8e36-36e7-4f5e-ad26-10d801dbfd0a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:53.175670 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd4b8e36-36e7-4f5e-ad26-10d801dbfd0a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:53.176556 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd4b8e36-36e7-4f5e-ad26-10d801dbfd0a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:53.176992 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd4b8e36-36e7-4f5e-ad26-10d801dbfd0a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:53.210747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-0c531e25-b780-4d99-a063-b707e1986311 req-d6e8ebf7-28a9-419a-bbf0-d115dafc9bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4feea556-3436-45e0-8758-048ba80be0c1", "tag": "42aa7a3c-e7c7-4181-90f3-524ad729aa3e"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:53.212966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:48:53.212966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:48:53.227997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-0c531e25-b780-4d99-a063-b707e1986311 req-d6e8ebf7-28a9-419a-bbf0-d115dafc9bca service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:53.227997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-0c531e25-b780-4d99-a063-b707e1986311 req-d6e8ebf7-28a9-419a-bbf0-d115dafc9bca service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:53.237785 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-0c531e25-b780-4d99-a063-b707e1986311 req-d6e8ebf7-28a9-419a-bbf0-d115dafc9bca service nova] Creating event network-changed:42aa7a3c-e7c7-4181-90f3-524ad729aa3e for instance 4feea556-3436-45e0-8758-048ba80be0c1 on hv-cinder-82660 Jan 31 04:48:53.244900 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-0c531e25-b780-4d99-a063-b707e1986311 req-d6e8ebf7-28a9-419a-bbf0-d115dafc9bca service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039089 Jan 31 04:48:53.246257 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 268/513] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:48:53.488215 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-bd4b8e36-36e7-4f5e-ad26-10d801dbfd0a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:53.497546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bd4b8e36-36e7-4f5e-ad26-10d801dbfd0a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.335560 Jan 31 04:48:53.506930 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 246/514] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:53 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:53.885787 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d4231d18-ed3c-47c6-a853-6dd0cd4457e4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:53.886583 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d4231d18-ed3c-47c6-a853-6dd0cd4457e4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:53.892555 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d4231d18-ed3c-47c6-a853-6dd0cd4457e4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:53.893079 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d4231d18-ed3c-47c6-a853-6dd0cd4457e4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:53.893934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d4231d18-ed3c-47c6-a853-6dd0cd4457e4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:53.894437 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d4231d18-ed3c-47c6-a853-6dd0cd4457e4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:54.110748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d4231d18-ed3c-47c6-a853-6dd0cd4457e4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:54.121601 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d4231d18-ed3c-47c6-a853-6dd0cd4457e4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.241045 Jan 31 04:48:54.122164 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 269/515] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:53 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:54.170422 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-beaef5e4-4e06-4b60-8fa3-d51fda3064da tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:54.171169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-beaef5e4-4e06-4b60-8fa3-d51fda3064da tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:54.177265 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-beaef5e4-4e06-4b60-8fa3-d51fda3064da tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:54.177780 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-beaef5e4-4e06-4b60-8fa3-d51fda3064da tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:54.178647 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-beaef5e4-4e06-4b60-8fa3-d51fda3064da tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:54.179362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-beaef5e4-4e06-4b60-8fa3-d51fda3064da tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:54.314978 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-beaef5e4-4e06-4b60-8fa3-d51fda3064da tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:54.326686 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-beaef5e4-4e06-4b60-8fa3-d51fda3064da tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1555 microversion: 2.1 time: 0.160038 Jan 31 04:48:54.327284 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 247/516] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:54 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:54.514000 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5947718f-fae5-4ab1-b5e8-2ca69497580d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:54.514604 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5947718f-fae5-4ab1-b5e8-2ca69497580d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:54.520442 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5947718f-fae5-4ab1-b5e8-2ca69497580d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:54.523584 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5947718f-fae5-4ab1-b5e8-2ca69497580d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:54.523584 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5947718f-fae5-4ab1-b5e8-2ca69497580d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:54.523584 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5947718f-fae5-4ab1-b5e8-2ca69497580d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:54.661700 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5947718f-fae5-4ab1-b5e8-2ca69497580d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:54.669018 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5947718f-fae5-4ab1-b5e8-2ca69497580d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.158659 Jan 31 04:48:54.669589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 270/517] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:54 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:55.138845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ea06b039-a5d0-43d8-b1b6-a526ec074bf5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:55.139561 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ea06b039-a5d0-43d8-b1b6-a526ec074bf5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:55.145993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea06b039-a5d0-43d8-b1b6-a526ec074bf5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:55.146431 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea06b039-a5d0-43d8-b1b6-a526ec074bf5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:55.147267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea06b039-a5d0-43d8-b1b6-a526ec074bf5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:55.147739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea06b039-a5d0-43d8-b1b6-a526ec074bf5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:55.287513 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ea06b039-a5d0-43d8-b1b6-a526ec074bf5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:55.295960 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ea06b039-a5d0-43d8-b1b6-a526ec074bf5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.160621 Jan 31 04:48:55.299078 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 248/518] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:55 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:55.343745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2f961034-2e7f-4724-aedf-2e5549665283 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:55.344377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2f961034-2e7f-4724-aedf-2e5549665283 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:55.350601 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f961034-2e7f-4724-aedf-2e5549665283 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:55.352082 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f961034-2e7f-4724-aedf-2e5549665283 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:55.352861 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f961034-2e7f-4724-aedf-2e5549665283 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:55.353450 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f961034-2e7f-4724-aedf-2e5549665283 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:55.490249 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2f961034-2e7f-4724-aedf-2e5549665283 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:55.498138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2f961034-2e7f-4724-aedf-2e5549665283 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1555 microversion: 2.1 time: 0.158247 Jan 31 04:48:55.498709 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 271/519] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:55 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:55.686328 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-44c084c2-006e-45c4-ad6c-f4a4bfc0c4d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:55.687009 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-44c084c2-006e-45c4-ad6c-f4a4bfc0c4d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:55.693074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-44c084c2-006e-45c4-ad6c-f4a4bfc0c4d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:55.693518 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-44c084c2-006e-45c4-ad6c-f4a4bfc0c4d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:55.694290 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-44c084c2-006e-45c4-ad6c-f4a4bfc0c4d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:55.695250 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-44c084c2-006e-45c4-ad6c-f4a4bfc0c4d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:55.824782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-44c084c2-006e-45c4-ad6c-f4a4bfc0c4d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:55.832664 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-44c084c2-006e-45c4-ad6c-f4a4bfc0c4d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.150390 Jan 31 04:48:55.833224 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 249/520] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:55 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:56.313180 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-10efbf79-e4d3-4243-821b-20862fc097b6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:56.313783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-10efbf79-e4d3-4243-821b-20862fc097b6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:56.320592 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10efbf79-e4d3-4243-821b-20862fc097b6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:56.321067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10efbf79-e4d3-4243-821b-20862fc097b6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:56.321939 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10efbf79-e4d3-4243-821b-20862fc097b6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:56.322422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10efbf79-e4d3-4243-821b-20862fc097b6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:56.460423 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-10efbf79-e4d3-4243-821b-20862fc097b6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:56.467618 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-10efbf79-e4d3-4243-821b-20862fc097b6 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.158135 Jan 31 04:48:56.468165 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 272/521] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:56 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:56.515100 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-eee2c3c1-623c-4e1c-9714-75c15d8981d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:56.515709 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-eee2c3c1-623c-4e1c-9714-75c15d8981d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:56.521944 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eee2c3c1-623c-4e1c-9714-75c15d8981d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:56.522392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eee2c3c1-623c-4e1c-9714-75c15d8981d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:56.523271 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eee2c3c1-623c-4e1c-9714-75c15d8981d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:56.523706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-eee2c3c1-623c-4e1c-9714-75c15d8981d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:56.658556 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-eee2c3c1-623c-4e1c-9714-75c15d8981d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:56.666965 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-eee2c3c1-623c-4e1c-9714-75c15d8981d1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1555 microversion: 2.1 time: 0.155435 Jan 31 04:48:56.667523 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 250/522] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:56 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:56.849049 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4ec2cf82-9da6-4030-8019-c5e2fb996eee tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:56.849648 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4ec2cf82-9da6-4030-8019-c5e2fb996eee tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:56.856263 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4ec2cf82-9da6-4030-8019-c5e2fb996eee tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:56.856690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4ec2cf82-9da6-4030-8019-c5e2fb996eee tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:56.857452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4ec2cf82-9da6-4030-8019-c5e2fb996eee tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:56.857877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4ec2cf82-9da6-4030-8019-c5e2fb996eee tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:56.993962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4ec2cf82-9da6-4030-8019-c5e2fb996eee tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:57.001580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4ec2cf82-9da6-4030-8019-c5e2fb996eee tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.156145 Jan 31 04:48:57.002211 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 273/523] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:56 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:57.365384 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-7badfe22-82eb-4db5-b251-9c83edf464a4 req-3b90c594-f4ff-4d10-9c72-81893393ffec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caeb7284-3cc9-4e25-8268-f4aa7eb66ab9", "name": "network-vif-plugged", "status": "completed", "tag": "482834c2-7b2c-4fdc-aec2-6bf0968d1671"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:48:57.367269 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:48:57.367269 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:48:57.374579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-7badfe22-82eb-4db5-b251-9c83edf464a4 req-3b90c594-f4ff-4d10-9c72-81893393ffec service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:57.375035 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-7badfe22-82eb-4db5-b251-9c83edf464a4 req-3b90c594-f4ff-4d10-9c72-81893393ffec service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:57.387149 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-7badfe22-82eb-4db5-b251-9c83edf464a4 req-3b90c594-f4ff-4d10-9c72-81893393ffec service nova] Creating event network-vif-plugged:482834c2-7b2c-4fdc-aec2-6bf0968d1671 for instance caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 on hv-cinder-82660 Jan 31 04:48:57.391916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-7badfe22-82eb-4db5-b251-9c83edf464a4 req-3b90c594-f4ff-4d10-9c72-81893393ffec service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030208 Jan 31 04:48:57.392532 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 251/524] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:48:57.485169 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-43c36d66-0777-446c-bac8-a207de4a82d0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:57.485819 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-43c36d66-0777-446c-bac8-a207de4a82d0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:57.505162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43c36d66-0777-446c-bac8-a207de4a82d0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:57.505602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43c36d66-0777-446c-bac8-a207de4a82d0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:57.506379 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43c36d66-0777-446c-bac8-a207de4a82d0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:57.506831 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43c36d66-0777-446c-bac8-a207de4a82d0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:57.646499 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-43c36d66-0777-446c-bac8-a207de4a82d0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:57.653879 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-43c36d66-0777-446c-bac8-a207de4a82d0 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.172573 Jan 31 04:48:57.654446 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 274/525] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:57 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:57.685224 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-79d4d135-0a51-4923-8764-883ee0ccf7cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:57.686040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-79d4d135-0a51-4923-8764-883ee0ccf7cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:57.692199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-79d4d135-0a51-4923-8764-883ee0ccf7cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:57.692652 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-79d4d135-0a51-4923-8764-883ee0ccf7cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:57.693425 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-79d4d135-0a51-4923-8764-883ee0ccf7cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:57.694061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-79d4d135-0a51-4923-8764-883ee0ccf7cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:57.833221 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-79d4d135-0a51-4923-8764-883ee0ccf7cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:57.841428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-79d4d135-0a51-4923-8764-883ee0ccf7cc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1555 microversion: 2.1 time: 0.160699 Jan 31 04:48:57.842016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 252/526] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:57 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:58.018414 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3aca4b64-5cbc-4666-993e-37a85417a3a9 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:58.019056 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3aca4b64-5cbc-4666-993e-37a85417a3a9 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:58.025686 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3aca4b64-5cbc-4666-993e-37a85417a3a9 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:58.026126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3aca4b64-5cbc-4666-993e-37a85417a3a9 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:58.026932 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3aca4b64-5cbc-4666-993e-37a85417a3a9 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:58.027372 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3aca4b64-5cbc-4666-993e-37a85417a3a9 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:58.161789 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3aca4b64-5cbc-4666-993e-37a85417a3a9 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:58.169306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3aca4b64-5cbc-4666-993e-37a85417a3a9 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.154495 Jan 31 04:48:58.169874 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 275/527] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:58 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:58.670714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-18e63714-6642-46c9-ab78-a20eca10825f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:58.671347 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-18e63714-6642-46c9-ab78-a20eca10825f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:58.677255 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-18e63714-6642-46c9-ab78-a20eca10825f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:58.677703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-18e63714-6642-46c9-ab78-a20eca10825f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:58.678469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-18e63714-6642-46c9-ab78-a20eca10825f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:58.679609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-18e63714-6642-46c9-ab78-a20eca10825f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:58.810243 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-18e63714-6642-46c9-ab78-a20eca10825f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:58.817419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-18e63714-6642-46c9-ab78-a20eca10825f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.150301 Jan 31 04:48:58.817970 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 253/528] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:58 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:58.858973 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2f45574f-2e35-4c9d-9007-fce8b24b7684 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:58.859581 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2f45574f-2e35-4c9d-9007-fce8b24b7684 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:58.865470 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f45574f-2e35-4c9d-9007-fce8b24b7684 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:58.865918 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f45574f-2e35-4c9d-9007-fce8b24b7684 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:58.867464 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f45574f-2e35-4c9d-9007-fce8b24b7684 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:58.867904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f45574f-2e35-4c9d-9007-fce8b24b7684 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:58.997580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2f45574f-2e35-4c9d-9007-fce8b24b7684 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:59.005453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2f45574f-2e35-4c9d-9007-fce8b24b7684 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1561 microversion: 2.1 time: 0.150431 Jan 31 04:48:59.006011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 276/529] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:58 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:48:59.070069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f7c882ef-c4e0-4aff-a086-49003067cd0b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:59.070545 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f7c882ef-c4e0-4aff-a086-49003067cd0b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:59.076368 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f7c882ef-c4e0-4aff-a086-49003067cd0b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:59.076810 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f7c882ef-c4e0-4aff-a086-49003067cd0b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:59.077582 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f7c882ef-c4e0-4aff-a086-49003067cd0b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:59.078017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f7c882ef-c4e0-4aff-a086-49003067cd0b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:59.156581 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-f7c882ef-c4e0-4aff-a086-49003067cd0b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lazy-loading 'services' on Instance uuid 81eea382-424b-4435-9241-e428592c98f3 {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:48:59.185405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1caf31f9-06ba-4a36-9336-f05f85cf2823 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:59.186011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1caf31f9-06ba-4a36-9336-f05f85cf2823 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:59.193698 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1caf31f9-06ba-4a36-9336-f05f85cf2823 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:59.194226 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1caf31f9-06ba-4a36-9336-f05f85cf2823 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:59.195123 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1caf31f9-06ba-4a36-9336-f05f85cf2823 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:59.195655 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1caf31f9-06ba-4a36-9336-f05f85cf2823 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:59.337741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f7c882ef-c4e0-4aff-a086-49003067cd0b tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "DELETE /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments/7a5e1961-5119-4c02-9c92-76599553712a" status: 202 len: 0 microversion: 2.1 time: 0.271114 Jan 31 04:48:59.338627 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 254/530] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:48:59 2022] DELETE /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments/7a5e1961-5119-4c02-9c92-76599553712a => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:48:59.343531 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1caf31f9-06ba-4a36-9336-f05f85cf2823 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:59.347082 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5631ad0e-b707-4840-8262-742db440db7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:59.348119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5631ad0e-b707-4840-8262-742db440db7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:59.355462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1caf31f9-06ba-4a36-9336-f05f85cf2823 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.173605 Jan 31 04:48:59.365079 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5631ad0e-b707-4840-8262-742db440db7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:59.365465 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 277/531] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:59 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:48:59.366736 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5631ad0e-b707-4840-8262-742db440db7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:59.367594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5631ad0e-b707-4840-8262-742db440db7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:59.368028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5631ad0e-b707-4840-8262-742db440db7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:59.401983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5631ad0e-b707-4840-8262-742db440db7c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058775 Jan 31 04:48:59.402595 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 255/532] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:48:59 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:48:59.834285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-38098f74-dfe0-4885-8977-a74762a048ba tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:48:59.834891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-38098f74-dfe0-4885-8977-a74762a048ba tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:48:59.841265 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38098f74-dfe0-4885-8977-a74762a048ba tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:59.841716 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38098f74-dfe0-4885-8977-a74762a048ba tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:59.842658 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38098f74-dfe0-4885-8977-a74762a048ba tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:48:59.843306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38098f74-dfe0-4885-8977-a74762a048ba tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:48:59.976864 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-38098f74-dfe0-4885-8977-a74762a048ba tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:48:59.984672 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-38098f74-dfe0-4885-8977-a74762a048ba tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1318 microversion: 2.1 time: 0.154023 Jan 31 04:48:59.985242 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 278/533] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:48:59 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:00.371513 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7f44102f-e1ac-4844-9fe3-c227a2709fe5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:00.372040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7f44102f-e1ac-4844-9fe3-c227a2709fe5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:00.378585 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f44102f-e1ac-4844-9fe3-c227a2709fe5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:00.379063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f44102f-e1ac-4844-9fe3-c227a2709fe5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:00.379825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f44102f-e1ac-4844-9fe3-c227a2709fe5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:00.380254 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f44102f-e1ac-4844-9fe3-c227a2709fe5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:00.414602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-052b6db4-5941-4aaa-a6dd-47ebaa354d9c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:00.415759 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-052b6db4-5941-4aaa-a6dd-47ebaa354d9c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:00.421716 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-052b6db4-5941-4aaa-a6dd-47ebaa354d9c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:00.422167 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-052b6db4-5941-4aaa-a6dd-47ebaa354d9c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:00.424740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-052b6db4-5941-4aaa-a6dd-47ebaa354d9c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:00.424740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-052b6db4-5941-4aaa-a6dd-47ebaa354d9c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:00.454530 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-052b6db4-5941-4aaa-a6dd-47ebaa354d9c tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Jan 31 04:49:00.455131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 279/534] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:49:00 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:49:00.522274 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7f44102f-e1ac-4844-9fe3-c227a2709fe5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:00.529975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7f44102f-e1ac-4844-9fe3-c227a2709fe5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.162016 Jan 31 04:49:00.530537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 256/535] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:00 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:01.001602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-555b48a9-9735-439d-9270-44be0e736803 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:01.002244 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-555b48a9-9735-439d-9270-44be0e736803 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:01.008885 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-555b48a9-9735-439d-9270-44be0e736803 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:01.009323 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-555b48a9-9735-439d-9270-44be0e736803 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:01.010084 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-555b48a9-9735-439d-9270-44be0e736803 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:01.010513 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-555b48a9-9735-439d-9270-44be0e736803 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:01.153978 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-555b48a9-9735-439d-9270-44be0e736803 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:01.161284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-555b48a9-9735-439d-9270-44be0e736803 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1508 microversion: 2.1 time: 0.163417 Jan 31 04:49:01.163046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 280/536] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:00 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:01.465632 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4204e9d9-2db8-4c0e-91e9-9fca0c707653 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:01.466575 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4204e9d9-2db8-4c0e-91e9-9fca0c707653 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:01.472811 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4204e9d9-2db8-4c0e-91e9-9fca0c707653 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:01.473250 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4204e9d9-2db8-4c0e-91e9-9fca0c707653 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:01.474009 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4204e9d9-2db8-4c0e-91e9-9fca0c707653 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:01.474431 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4204e9d9-2db8-4c0e-91e9-9fca0c707653 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:01.503684 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4204e9d9-2db8-4c0e-91e9-9fca0c707653 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041785 Jan 31 04:49:01.504250 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 257/537] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:49:01 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 04:49:01.546453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-af1a0333-2c7e-441e-ba12-ba35e8070ae6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:01.547435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-af1a0333-2c7e-441e-ba12-ba35e8070ae6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:01.562448 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af1a0333-2c7e-441e-ba12-ba35e8070ae6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:01.563143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af1a0333-2c7e-441e-ba12-ba35e8070ae6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:01.564053 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af1a0333-2c7e-441e-ba12-ba35e8070ae6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:01.564583 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af1a0333-2c7e-441e-ba12-ba35e8070ae6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:01.718003 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-af1a0333-2c7e-441e-ba12-ba35e8070ae6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:01.725354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-af1a0333-2c7e-441e-ba12-ba35e8070ae6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.182599 Jan 31 04:49:01.727204 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 281/538] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:01 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:02.743977 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b7badc9f-7f22-4813-9a3f-aca3f9ce8c68 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:02.744576 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b7badc9f-7f22-4813-9a3f-aca3f9ce8c68 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:02.750365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b7badc9f-7f22-4813-9a3f-aca3f9ce8c68 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:02.750814 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b7badc9f-7f22-4813-9a3f-aca3f9ce8c68 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:02.751591 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b7badc9f-7f22-4813-9a3f-aca3f9ce8c68 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:02.752024 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b7badc9f-7f22-4813-9a3f-aca3f9ce8c68 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:02.893835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b7badc9f-7f22-4813-9a3f-aca3f9ce8c68 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:02.900974 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b7badc9f-7f22-4813-9a3f-aca3f9ce8c68 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.161291 Jan 31 04:49:02.901527 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 258/539] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:02 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:03.354874 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-3f76c356-4de1-46ed-86a2-2b41959f4c0f req-7e9c11a5-d71f-4904-997f-74bfa1baa8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4feea556-3436-45e0-8758-048ba80be0c1", "name": "network-vif-plugged", "status": "completed", "tag": "42aa7a3c-e7c7-4181-90f3-524ad729aa3e"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:03.356428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:03.356428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:03.364005 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-3f76c356-4de1-46ed-86a2-2b41959f4c0f req-7e9c11a5-d71f-4904-997f-74bfa1baa8ce service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:03.364440 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-3f76c356-4de1-46ed-86a2-2b41959f4c0f req-7e9c11a5-d71f-4904-997f-74bfa1baa8ce service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:03.376236 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-3f76c356-4de1-46ed-86a2-2b41959f4c0f req-7e9c11a5-d71f-4904-997f-74bfa1baa8ce service nova] Creating event network-vif-plugged:42aa7a3c-e7c7-4181-90f3-524ad729aa3e for instance 4feea556-3436-45e0-8758-048ba80be0c1 on hv-cinder-82660 Jan 31 04:49:03.381331 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-3f76c356-4de1-46ed-86a2-2b41959f4c0f req-7e9c11a5-d71f-4904-997f-74bfa1baa8ce service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030882 Jan 31 04:49:03.381906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 282/540] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:49:03.864381 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d4373fff-e00a-4b53-8181-b0a3784673af tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3561a3b9-36be-4975-9f26-37593ebec7ca"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:03.865433 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d4373fff-e00a-4b53-8181-b0a3784673af tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:03.871777 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d4373fff-e00a-4b53-8181-b0a3784673af tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:03.872269 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d4373fff-e00a-4b53-8181-b0a3784673af tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:03.873036 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d4373fff-e00a-4b53-8181-b0a3784673af tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:03.873466 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d4373fff-e00a-4b53-8181-b0a3784673af tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:03.917821 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-47e07c9a-5c97-4283-b025-8b95944ba5ce tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:03.918518 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-47e07c9a-5c97-4283-b025-8b95944ba5ce tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:03.924863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-47e07c9a-5c97-4283-b025-8b95944ba5ce tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:03.925342 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-47e07c9a-5c97-4283-b025-8b95944ba5ce tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:03.926157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-47e07c9a-5c97-4283-b025-8b95944ba5ce tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:03.926593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-47e07c9a-5c97-4283-b025-8b95944ba5ce tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:04.061440 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-47e07c9a-5c97-4283-b025-8b95944ba5ce tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:04.068798 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-47e07c9a-5c97-4283-b025-8b95944ba5ce tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.154916 Jan 31 04:49:04.069453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 283/541] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:03 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:04.082757 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e87c4a23-a46a-4f79-bfb0-5217bb903d1e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:04.083274 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e87c4a23-a46a-4f79-bfb0-5217bb903d1e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:04.089974 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e87c4a23-a46a-4f79-bfb0-5217bb903d1e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:04.090521 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e87c4a23-a46a-4f79-bfb0-5217bb903d1e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:04.091661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e87c4a23-a46a-4f79-bfb0-5217bb903d1e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:04.092287 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e87c4a23-a46a-4f79-bfb0-5217bb903d1e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:04.117703 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e87c4a23-a46a-4f79-bfb0-5217bb903d1e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:49:04.389407 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e87c4a23-a46a-4f79-bfb0-5217bb903d1e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 204 len: 0 microversion: 2.1 time: 0.309705 Jan 31 04:49:04.390091 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 284/542] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:49:04 2022] DELETE /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:49:04.397918 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9509b87a-e3c3-45cb-8b50-084cf81a3120 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:04.398642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9509b87a-e3c3-45cb-8b50-084cf81a3120 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:04.404628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9509b87a-e3c3-45cb-8b50-084cf81a3120 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:04.405131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9509b87a-e3c3-45cb-8b50-084cf81a3120 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:04.405953 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9509b87a-e3c3-45cb-8b50-084cf81a3120 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:04.406370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9509b87a-e3c3-45cb-8b50-084cf81a3120 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:04.539936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9509b87a-e3c3-45cb-8b50-084cf81a3120 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:04.547370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9509b87a-e3c3-45cb-8b50-084cf81a3120 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1506 microversion: 2.1 time: 0.153154 Jan 31 04:49:04.547939 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 285/543] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:04 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:05.055619 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d4373fff-e00a-4b53-8181-b0a3784673af tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "POST /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.194367 Jan 31 04:49:05.056359 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 259/544] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:49:03 2022] POST /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments => generated 194 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:05.085303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f2554d17-5acc-490c-bec5-889479c2b395 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:05.086832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f2554d17-5acc-490c-bec5-889479c2b395 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:05.094072 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f2554d17-5acc-490c-bec5-889479c2b395 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:05.094513 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f2554d17-5acc-490c-bec5-889479c2b395 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:05.098036 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f2554d17-5acc-490c-bec5-889479c2b395 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:05.098479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f2554d17-5acc-490c-bec5-889479c2b395 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:05.251131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f2554d17-5acc-490c-bec5-889479c2b395 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:05.258648 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f2554d17-5acc-490c-bec5-889479c2b395 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.177067 Jan 31 04:49:05.259395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 286/545] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:05 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:05.565693 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5088364f-fd0b-4ace-ad23-3a946a9436dd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:05.566332 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5088364f-fd0b-4ace-ad23-3a946a9436dd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:05.573680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5088364f-fd0b-4ace-ad23-3a946a9436dd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:05.574124 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5088364f-fd0b-4ace-ad23-3a946a9436dd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:05.574932 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5088364f-fd0b-4ace-ad23-3a946a9436dd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:05.575382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5088364f-fd0b-4ace-ad23-3a946a9436dd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:05.710694 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5088364f-fd0b-4ace-ad23-3a946a9436dd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:05.717933 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5088364f-fd0b-4ace-ad23-3a946a9436dd tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1506 microversion: 2.1 time: 0.156374 Jan 31 04:49:05.718594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 260/546] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:05 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:06.274377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c61aa55d-69c5-4d2d-9264-bb1247e3945c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:06.275008 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c61aa55d-69c5-4d2d-9264-bb1247e3945c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:06.281409 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c61aa55d-69c5-4d2d-9264-bb1247e3945c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:06.281854 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c61aa55d-69c5-4d2d-9264-bb1247e3945c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:06.282616 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c61aa55d-69c5-4d2d-9264-bb1247e3945c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:06.283069 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c61aa55d-69c5-4d2d-9264-bb1247e3945c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:06.420734 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c61aa55d-69c5-4d2d-9264-bb1247e3945c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:06.427890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c61aa55d-69c5-4d2d-9264-bb1247e3945c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1314 microversion: 2.1 time: 0.157192 Jan 31 04:49:06.428446 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 287/547] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:06 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:06.734909 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ecdaefe3-2fe1-4e05-8702-b412ab8953ad tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:06.735536 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ecdaefe3-2fe1-4e05-8702-b412ab8953ad tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:06.741649 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ecdaefe3-2fe1-4e05-8702-b412ab8953ad tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:06.742085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ecdaefe3-2fe1-4e05-8702-b412ab8953ad tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:06.742860 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ecdaefe3-2fe1-4e05-8702-b412ab8953ad tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:06.743337 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ecdaefe3-2fe1-4e05-8702-b412ab8953ad tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:06.873895 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ecdaefe3-2fe1-4e05-8702-b412ab8953ad tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:06.881338 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ecdaefe3-2fe1-4e05-8702-b412ab8953ad tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1506 microversion: 2.1 time: 0.149993 Jan 31 04:49:06.881893 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 261/548] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:06 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:07.444870 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2f6c2502-e83b-4f58-993a-995abb1c43d6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:07.445477 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2f6c2502-e83b-4f58-993a-995abb1c43d6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:07.452478 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f6c2502-e83b-4f58-993a-995abb1c43d6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:07.452923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f6c2502-e83b-4f58-993a-995abb1c43d6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:07.453689 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f6c2502-e83b-4f58-993a-995abb1c43d6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:07.454120 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2f6c2502-e83b-4f58-993a-995abb1c43d6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:07.585722 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2f6c2502-e83b-4f58-993a-995abb1c43d6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:07.592860 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2f6c2502-e83b-4f58-993a-995abb1c43d6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1497 microversion: 2.1 time: 0.151524 Jan 31 04:49:07.593420 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 288/549] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:07 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:07.898325 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c4af2a02-6da6-4d43-9c45-5d99220af985 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:07.898858 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c4af2a02-6da6-4d43-9c45-5d99220af985 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:07.906263 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c4af2a02-6da6-4d43-9c45-5d99220af985 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:07.906708 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c4af2a02-6da6-4d43-9c45-5d99220af985 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:07.907500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c4af2a02-6da6-4d43-9c45-5d99220af985 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:07.907930 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c4af2a02-6da6-4d43-9c45-5d99220af985 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:08.039391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c4af2a02-6da6-4d43-9c45-5d99220af985 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:08.047293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c4af2a02-6da6-4d43-9c45-5d99220af985 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1506 microversion: 2.1 time: 0.152797 Jan 31 04:49:08.047864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 262/550] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:07 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:08.906108 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-33141b54-cfee-4417-8589-0c299ea20d2b req-56c00d3e-a324-4c34-9f3d-70e84665dd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7066f95-24c8-4df3-8703-78616c09fd0e", "name": "network-vif-deleted", "tag": "48d0d5c8-7822-42f9-8635-3991c50d27a3"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:08.907726 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:08.907726 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:08.916000 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-33141b54-cfee-4417-8589-0c299ea20d2b req-56c00d3e-a324-4c34-9f3d-70e84665dd16 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:08.916447 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-33141b54-cfee-4417-8589-0c299ea20d2b req-56c00d3e-a324-4c34-9f3d-70e84665dd16 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:08.927566 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-33141b54-cfee-4417-8589-0c299ea20d2b req-56c00d3e-a324-4c34-9f3d-70e84665dd16 service nova] Creating event network-vif-deleted:48d0d5c8-7822-42f9-8635-3991c50d27a3 for instance c7066f95-24c8-4df3-8703-78616c09fd0e on hv-cinder-82660 Jan 31 04:49:08.933298 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-33141b54-cfee-4417-8589-0c299ea20d2b req-56c00d3e-a324-4c34-9f3d-70e84665dd16 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030699 Jan 31 04:49:08.933883 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 289/551] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:08.949251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-171e5cbd-383a-46c5-80df-7ab36388151c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:08.950378 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-171e5cbd-383a-46c5-80df-7ab36388151c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:08.956725 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-171e5cbd-383a-46c5-80df-7ab36388151c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:08.957173 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-171e5cbd-383a-46c5-80df-7ab36388151c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:08.957953 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-171e5cbd-383a-46c5-80df-7ab36388151c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:08.958412 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-171e5cbd-383a-46c5-80df-7ab36388151c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:08.989168 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-171e5cbd-383a-46c5-80df-7ab36388151c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:49:09.064597 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-59cafe15-5b31-45aa-bf5e-2851c4d46abf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:09.065330 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-59cafe15-5b31-45aa-bf5e-2851c4d46abf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:09.071772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-59cafe15-5b31-45aa-bf5e-2851c4d46abf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:09.072215 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-59cafe15-5b31-45aa-bf5e-2851c4d46abf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:09.075852 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-59cafe15-5b31-45aa-bf5e-2851c4d46abf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:09.075852 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-59cafe15-5b31-45aa-bf5e-2851c4d46abf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:09.144242 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-59cafe15-5b31-45aa-bf5e-2851c4d46abf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:09.152374 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-59cafe15-5b31-45aa-bf5e-2851c4d46abf tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 200 len: 1292 microversion: 2.1 time: 0.092287 Jan 31 04:49:09.152934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 290/552] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:09 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:09.286571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-171e5cbd-383a-46c5-80df-7ab36388151c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 204 len: 0 microversion: 2.1 time: 0.340950 Jan 31 04:49:09.289331 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 263/553] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:49:08 2022] DELETE /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:49:09.295411 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d8ee005c-2c21-4a36-88ea-46d6e61a51a6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:09.296005 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d8ee005c-2c21-4a36-88ea-46d6e61a51a6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:09.301930 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d8ee005c-2c21-4a36-88ea-46d6e61a51a6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:09.302368 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d8ee005c-2c21-4a36-88ea-46d6e61a51a6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:09.303303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d8ee005c-2c21-4a36-88ea-46d6e61a51a6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:09.303573 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d8ee005c-2c21-4a36-88ea-46d6e61a51a6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:09.440303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d8ee005c-2c21-4a36-88ea-46d6e61a51a6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:09.447989 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d8ee005c-2c21-4a36-88ea-46d6e61a51a6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1503 microversion: 2.1 time: 0.156219 Jan 31 04:49:09.448538 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 291/554] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:09 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:10.168934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:10.169649 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: c7066f95-24c8-4df3-8703-78616c09fd0e] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:10.176119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:10.176567 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:10.177337 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:10.177765 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:10.191966 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] HTTP exception thrown: Instance c7066f95-24c8-4df3-8703-78616c09fd0e could not be found. Jan 31 04:49:10.192584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Returning 404 to user: Instance c7066f95-24c8-4df3-8703-78616c09fd0e could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:10.193386 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5243c79b-577f-4dc0-b4f8-478fa15bfe32 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e" status: 404 len: 111 microversion: 2.1 time: 0.029112 Jan 31 04:49:10.193904 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 264/555] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:10 2022] GET /compute/v2.1/servers/c7066f95-24c8-4df3-8703-78616c09fd0e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:10.202014 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-183525b6-7461-496b-82f1-0a8862eba902 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:10.202601 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-183525b6-7461-496b-82f1-0a8862eba902 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:10.210546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-183525b6-7461-496b-82f1-0a8862eba902 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:10.211288 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-183525b6-7461-496b-82f1-0a8862eba902 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:10.212338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-183525b6-7461-496b-82f1-0a8862eba902 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:10.212768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-183525b6-7461-496b-82f1-0a8862eba902 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:10.237895 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-183525b6-7461-496b-82f1-0a8862eba902 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:49:10.464625 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e79e27f6-a934-408c-b208-da2e68ffba31 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:10.465225 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e79e27f6-a934-408c-b208-da2e68ffba31 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:10.471178 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e79e27f6-a934-408c-b208-da2e68ffba31 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:10.471615 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e79e27f6-a934-408c-b208-da2e68ffba31 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:10.472406 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e79e27f6-a934-408c-b208-da2e68ffba31 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:10.472829 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e79e27f6-a934-408c-b208-da2e68ffba31 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:10.526388 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-183525b6-7461-496b-82f1-0a8862eba902 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "DELETE /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 204 len: 0 microversion: 2.1 time: 0.327688 Jan 31 04:49:10.526996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 292/556] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:49:10 2022] DELETE /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:49:10.534919 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0f5526e3-b548-445a-be8c-273847ca491d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:10.535742 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0f5526e3-b548-445a-be8c-273847ca491d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:10.543122 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0f5526e3-b548-445a-be8c-273847ca491d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:10.543651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0f5526e3-b548-445a-be8c-273847ca491d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:10.544493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0f5526e3-b548-445a-be8c-273847ca491d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:10.545229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0f5526e3-b548-445a-be8c-273847ca491d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:10.608523 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e79e27f6-a934-408c-b208-da2e68ffba31 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:10.616017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e79e27f6-a934-408c-b208-da2e68ffba31 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1503 microversion: 2.1 time: 0.155073 Jan 31 04:49:10.617211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 265/557] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:10 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:10.681922 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0f5526e3-b548-445a-be8c-273847ca491d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:10.689124 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0f5526e3-b548-445a-be8c-273847ca491d tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.158040 Jan 31 04:49:10.689679 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 293/558] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:10 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:11.633883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3333997e-5c8b-42d2-8b01-846540b9dd18 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:11.634512 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3333997e-5c8b-42d2-8b01-846540b9dd18 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:11.640504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3333997e-5c8b-42d2-8b01-846540b9dd18 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:11.640940 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3333997e-5c8b-42d2-8b01-846540b9dd18 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:11.641692 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3333997e-5c8b-42d2-8b01-846540b9dd18 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:11.642114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3333997e-5c8b-42d2-8b01-846540b9dd18 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:11.705063 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-063ea68c-b9c5-41b7-a322-73ff5053da26 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:11.705867 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-063ea68c-b9c5-41b7-a322-73ff5053da26 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:11.712590 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-063ea68c-b9c5-41b7-a322-73ff5053da26 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:11.713186 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-063ea68c-b9c5-41b7-a322-73ff5053da26 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:11.713971 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-063ea68c-b9c5-41b7-a322-73ff5053da26 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:11.714400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-063ea68c-b9c5-41b7-a322-73ff5053da26 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:11.771107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3333997e-5c8b-42d2-8b01-846540b9dd18 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:11.778780 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3333997e-5c8b-42d2-8b01-846540b9dd18 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1503 microversion: 2.1 time: 0.148537 Jan 31 04:49:11.779364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 266/559] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:11 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:11.870901 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-063ea68c-b9c5-41b7-a322-73ff5053da26 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:11.878307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-063ea68c-b9c5-41b7-a322-73ff5053da26 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.176570 Jan 31 04:49:11.878883 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 294/560] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:11 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:12.347077 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-4b99b13d-b38c-46ac-bd16-7d0e4164ffd2 req-bb0d873d-9160-4bcc-bbc6-5f01f3645401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4feea556-3436-45e0-8758-048ba80be0c1", "name": "network-vif-deleted", "tag": "42aa7a3c-e7c7-4181-90f3-524ad729aa3e"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:12.348746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:12.348746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:49:12.356130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-4b99b13d-b38c-46ac-bd16-7d0e4164ffd2 req-bb0d873d-9160-4bcc-bbc6-5f01f3645401 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:12.356625 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-4b99b13d-b38c-46ac-bd16-7d0e4164ffd2 req-bb0d873d-9160-4bcc-bbc6-5f01f3645401 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:12.367679 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-4b99b13d-b38c-46ac-bd16-7d0e4164ffd2 req-bb0d873d-9160-4bcc-bbc6-5f01f3645401 service nova] Creating event network-vif-deleted:42aa7a3c-e7c7-4181-90f3-524ad729aa3e for instance 4feea556-3436-45e0-8758-048ba80be0c1 on hv-cinder-82660 Jan 31 04:49:12.372645 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-4b99b13d-b38c-46ac-bd16-7d0e4164ffd2 req-bb0d873d-9160-4bcc-bbc6-5f01f3645401 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029475 Jan 31 04:49:12.373224 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 267/561] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:12.795900 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:12.796440 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:12.802592 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:12.803065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:12.803833 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:12.804268 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:12.833886 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:12.834329 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:12.834772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lazy-loading 'fault' on Instance uuid 4feea556-3436-45e0-8758-048ba80be0c1 {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:49:12.874354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:12.881830 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-60757e71-0a51-41a5-ba53-c6447c98d19b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 200 len: 1304 microversion: 2.1 time: 0.089631 Jan 31 04:49:12.882388 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 295/562] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:12 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:12.895488 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8474bf8f-2b2e-40ea-9a59-a33a89e4c5a6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:12.896207 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8474bf8f-2b2e-40ea-9a59-a33a89e4c5a6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:12.902107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8474bf8f-2b2e-40ea-9a59-a33a89e4c5a6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:12.902555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8474bf8f-2b2e-40ea-9a59-a33a89e4c5a6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:12.903356 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8474bf8f-2b2e-40ea-9a59-a33a89e4c5a6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:12.903790 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8474bf8f-2b2e-40ea-9a59-a33a89e4c5a6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:13.035964 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8474bf8f-2b2e-40ea-9a59-a33a89e4c5a6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:13.043994 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8474bf8f-2b2e-40ea-9a59-a33a89e4c5a6 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.152774 Jan 31 04:49:13.044756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 268/563] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:12 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:13.663520 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6df944f9-0498-41e9-8260-035b370df35e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:13.664009 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6df944f9-0498-41e9-8260-035b370df35e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:13.670277 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6df944f9-0498-41e9-8260-035b370df35e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:13.670734 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6df944f9-0498-41e9-8260-035b370df35e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:13.671537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6df944f9-0498-41e9-8260-035b370df35e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:13.671970 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6df944f9-0498-41e9-8260-035b370df35e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:13.748724 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-6df944f9-0498-41e9-8260-035b370df35e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lazy-loading 'services' on Instance uuid caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:49:13.897668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:13.898306 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 4feea556-3436-45e0-8758-048ba80be0c1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:13.905564 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:13.906007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:13.906832 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:13.907269 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:13.920660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] HTTP exception thrown: Instance 4feea556-3436-45e0-8758-048ba80be0c1 could not be found. Jan 31 04:49:13.921233 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Returning 404 to user: Instance 4feea556-3436-45e0-8758-048ba80be0c1 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:13.922029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-df854ce1-5e31-4272-9ae7-400c8d40b0a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1" status: 404 len: 111 microversion: 2.1 time: 0.028064 Jan 31 04:49:13.922537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 269/564] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:13 2022] GET /compute/v2.1/servers/4feea556-3436-45e0-8758-048ba80be0c1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 04:49:13.941381 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6df944f9-0498-41e9-8260-035b370df35e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "DELETE /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments/3561a3b9-36be-4975-9f26-37593ebec7ca" status: 202 len: 0 microversion: 2.1 time: 0.281596 Jan 31 04:49:13.942201 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 296/565] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:49:13 2022] DELETE /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments/3561a3b9-36be-4975-9f26-37593ebec7ca => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:49:13.957048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-45103031-ab99-44cd-ab9f-7888776b0a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:13.957993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-45103031-ab99-44cd-ab9f-7888776b0a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:13.965012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-45103031-ab99-44cd-ab9f-7888776b0a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:13.965549 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-45103031-ab99-44cd-ab9f-7888776b0a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:13.966430 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-45103031-ab99-44cd-ab9f-7888776b0a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:13.967230 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-45103031-ab99-44cd-ab9f-7888776b0a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:13.972408 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1058487293", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "c4477f49-ebf4-4e7b-8c85-2d53d2a5b898"}]}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:13.997869 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-45103031-ab99-44cd-ab9f-7888776b0a5e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044860 Jan 31 04:49:13.998413 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 270/566] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:49:13 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:14.024032 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] validate_networks() for [('c4477f49-ebf4-4e7b-8c85-2d53d2a5b898', None, None, None, None, None)] {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:49:14.060710 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-62871167-ea51-4cbb-ab59-a3e144b03fec tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:14.061491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-62871167-ea51-4cbb-ab59-a3e144b03fec tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:14.067412 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62871167-ea51-4cbb-ab59-a3e144b03fec tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:14.067948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62871167-ea51-4cbb-ab59-a3e144b03fec tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:14.068781 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62871167-ea51-4cbb-ab59-a3e144b03fec tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:14.069288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62871167-ea51-4cbb-ab59-a3e144b03fec tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:14.210861 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-62871167-ea51-4cbb-ab59-a3e144b03fec tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:14.218893 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-62871167-ea51-4cbb-ab59-a3e144b03fec tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.161805 Jan 31 04:49:14.219451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 271/567] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:14 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:14.364192 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:49:14.364669 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:49:14.365171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:49:14.365604 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:49:14.366012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:49:14.375144 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:14.375589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:14.376389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:14.376825 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:14.392924 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Getting quotas for project 30fced24126f40ac94f018df7c960a15. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:49:14.396738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Getting quotas for user e7557280caf846d6bdd96d80e1d28333 and project 30fced24126f40ac94f018df7c960a15. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:49:14.407241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:49:14.409615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:49:14.824784 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a2da3e7c-b3be-4740-8789-70dcbb252b4a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856431 Jan 31 04:49:14.825429 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 297/568] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:49:14.835132 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-aa1741bf-9d5b-44e4-bbd4-27b0eba218e1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:14.835870 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-aa1741bf-9d5b-44e4-bbd4-27b0eba218e1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:14.898287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-aa1741bf-9d5b-44e4-bbd4-27b0eba218e1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:14.905734 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-aa1741bf-9d5b-44e4-bbd4-27b0eba218e1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1214 microversion: 2.1 time: 0.074264 Jan 31 04:49:14.906346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 272/569] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:14 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:15.009598 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9300fe49-51c2-4588-8cf0-c048c167131f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:15.010601 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9300fe49-51c2-4588-8cf0-c048c167131f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:15.016690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9300fe49-51c2-4588-8cf0-c048c167131f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:15.017138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9300fe49-51c2-4588-8cf0-c048c167131f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:15.017906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9300fe49-51c2-4588-8cf0-c048c167131f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:15.018340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9300fe49-51c2-4588-8cf0-c048c167131f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:15.049012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9300fe49-51c2-4588-8cf0-c048c167131f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Jan 31 04:49:15.049575 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 298/570] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:49:15 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:15.236087 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-31248b60-b266-48ca-b2c1-d843012dc6bc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:15.236714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-31248b60-b266-48ca-b2c1-d843012dc6bc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:15.242596 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31248b60-b266-48ca-b2c1-d843012dc6bc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:15.243137 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31248b60-b266-48ca-b2c1-d843012dc6bc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:15.244030 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31248b60-b266-48ca-b2c1-d843012dc6bc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:15.244491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31248b60-b266-48ca-b2c1-d843012dc6bc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:15.397082 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-31248b60-b266-48ca-b2c1-d843012dc6bc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:15.403807 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-31248b60-b266-48ca-b2c1-d843012dc6bc tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.171374 Jan 31 04:49:15.404375 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 273/571] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:15 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:15.923167 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cbb502da-4035-4ac2-be36-d8f3245dd3b1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:15.923767 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cbb502da-4035-4ac2-be36-d8f3245dd3b1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:15.929914 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbb502da-4035-4ac2-be36-d8f3245dd3b1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:15.930386 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbb502da-4035-4ac2-be36-d8f3245dd3b1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:15.932592 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbb502da-4035-4ac2-be36-d8f3245dd3b1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:15.933064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbb502da-4035-4ac2-be36-d8f3245dd3b1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:15.995235 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cbb502da-4035-4ac2-be36-d8f3245dd3b1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:16.002486 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cbb502da-4035-4ac2-be36-d8f3245dd3b1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1210 microversion: 2.1 time: 0.082837 Jan 31 04:49:16.003310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 299/572] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:15 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:16.061170 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9e00bc09-e14f-4257-9470-0ca4e987e454 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:16.062080 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9e00bc09-e14f-4257-9470-0ca4e987e454 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:16.069023 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e00bc09-e14f-4257-9470-0ca4e987e454 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:16.069467 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e00bc09-e14f-4257-9470-0ca4e987e454 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:16.070244 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e00bc09-e14f-4257-9470-0ca4e987e454 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:16.070673 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e00bc09-e14f-4257-9470-0ca4e987e454 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:16.099878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9e00bc09-e14f-4257-9470-0ca4e987e454 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042384 Jan 31 04:49:16.100447 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 274/573] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:49:16 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 04:49:16.421359 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b5a482e5-8b22-44d6-8208-b07d71413fc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:16.421966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b5a482e5-8b22-44d6-8208-b07d71413fc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:16.427872 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b5a482e5-8b22-44d6-8208-b07d71413fc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:16.428319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b5a482e5-8b22-44d6-8208-b07d71413fc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:16.429088 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b5a482e5-8b22-44d6-8208-b07d71413fc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:16.429520 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b5a482e5-8b22-44d6-8208-b07d71413fc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:16.559236 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b5a482e5-8b22-44d6-8208-b07d71413fc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:16.566466 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b5a482e5-8b22-44d6-8208-b07d71413fc1 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.148802 Jan 31 04:49:16.567057 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 300/574] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:16 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:17.020247 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c6810880-402e-45d6-b864-51742d9c7693 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:17.021091 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c6810880-402e-45d6-b864-51742d9c7693 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:17.027507 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c6810880-402e-45d6-b864-51742d9c7693 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:17.028048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c6810880-402e-45d6-b864-51742d9c7693 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:17.028889 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c6810880-402e-45d6-b864-51742d9c7693 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:17.029388 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c6810880-402e-45d6-b864-51742d9c7693 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:17.102658 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c6810880-402e-45d6-b864-51742d9c7693 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:17.110238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c6810880-402e-45d6-b864-51742d9c7693 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1272 microversion: 2.1 time: 0.093620 Jan 31 04:49:17.110815 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 275/575] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:17 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:17.363714 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ca9990b2-ebea-42c1-9ba7-85245deeddfc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:17.364200 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ca9990b2-ebea-42c1-9ba7-85245deeddfc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:17.370432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ca9990b2-ebea-42c1-9ba7-85245deeddfc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:17.370909 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ca9990b2-ebea-42c1-9ba7-85245deeddfc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:17.371679 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ca9990b2-ebea-42c1-9ba7-85245deeddfc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:17.372223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ca9990b2-ebea-42c1-9ba7-85245deeddfc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:17.397785 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ca9990b2-ebea-42c1-9ba7-85245deeddfc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:49:17.583535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b4ac92fb-b465-40ec-af99-b2e62074d539 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:17.584133 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b4ac92fb-b465-40ec-af99-b2e62074d539 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:17.590963 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b4ac92fb-b465-40ec-af99-b2e62074d539 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:17.591415 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b4ac92fb-b465-40ec-af99-b2e62074d539 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:17.592577 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b4ac92fb-b465-40ec-af99-b2e62074d539 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:17.592697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b4ac92fb-b465-40ec-af99-b2e62074d539 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:17.653444 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ca9990b2-ebea-42c1-9ba7-85245deeddfc tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "DELETE /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 204 len: 0 microversion: 2.1 time: 0.293319 Jan 31 04:49:17.655291 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 301/576] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:49:17 2022] DELETE /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:49:17.663461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-15cb55c1-c678-4309-9cec-52aecd87dfb5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:17.664224 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-15cb55c1-c678-4309-9cec-52aecd87dfb5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:17.672349 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-15cb55c1-c678-4309-9cec-52aecd87dfb5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:17.672826 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-15cb55c1-c678-4309-9cec-52aecd87dfb5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:17.673606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-15cb55c1-c678-4309-9cec-52aecd87dfb5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:17.674046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-15cb55c1-c678-4309-9cec-52aecd87dfb5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:17.731943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b4ac92fb-b465-40ec-af99-b2e62074d539 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:17.739676 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b4ac92fb-b465-40ec-af99-b2e62074d539 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.160031 Jan 31 04:49:17.746446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 276/577] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:17 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:17.852282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-15cb55c1-c678-4309-9cec-52aecd87dfb5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:17.860247 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-15cb55c1-c678-4309-9cec-52aecd87dfb5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1514 microversion: 2.1 time: 0.200812 Jan 31 04:49:17.860827 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 302/578] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:17 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:18.129912 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-793c83fa-3113-4c3c-97c9-3d31ce64813a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:18.130540 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-793c83fa-3113-4c3c-97c9-3d31ce64813a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:18.137465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-793c83fa-3113-4c3c-97c9-3d31ce64813a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:18.137905 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-793c83fa-3113-4c3c-97c9-3d31ce64813a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:18.138666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-793c83fa-3113-4c3c-97c9-3d31ce64813a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:18.139133 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-793c83fa-3113-4c3c-97c9-3d31ce64813a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:18.273517 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-793c83fa-3113-4c3c-97c9-3d31ce64813a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:18.281855 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-793c83fa-3113-4c3c-97c9-3d31ce64813a tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.155737 Jan 31 04:49:18.290956 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 277/579] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:18 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:18.544773 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-9962ba6a-585a-4fbb-bb9b-f5067cd691d6 req-2b0fa57a-48db-4ed9-8daf-e6069fdad31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d20274-e8c9-4f5b-84d4-f12eac012abe", "tag": "69114b81-aa53-4115-81e1-c8240edf52b6"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:18.546382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:18.546382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:18.553555 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-9962ba6a-585a-4fbb-bb9b-f5067cd691d6 req-2b0fa57a-48db-4ed9-8daf-e6069fdad31c service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:18.554090 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-9962ba6a-585a-4fbb-bb9b-f5067cd691d6 req-2b0fa57a-48db-4ed9-8daf-e6069fdad31c service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:18.565798 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-9962ba6a-585a-4fbb-bb9b-f5067cd691d6 req-2b0fa57a-48db-4ed9-8daf-e6069fdad31c service nova] Creating event network-changed:69114b81-aa53-4115-81e1-c8240edf52b6 for instance 77d20274-e8c9-4f5b-84d4-f12eac012abe on hv-cinder-82660 Jan 31 04:49:18.570378 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-9962ba6a-585a-4fbb-bb9b-f5067cd691d6 req-2b0fa57a-48db-4ed9-8daf-e6069fdad31c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029197 Jan 31 04:49:18.571052 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 303/580] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:18.757197 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-428db718-a00d-4d8b-a0dd-0be64f73ba2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:18.757831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-428db718-a00d-4d8b-a0dd-0be64f73ba2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:18.764292 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-428db718-a00d-4d8b-a0dd-0be64f73ba2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:18.764729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-428db718-a00d-4d8b-a0dd-0be64f73ba2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:18.765504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-428db718-a00d-4d8b-a0dd-0be64f73ba2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:18.765931 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-428db718-a00d-4d8b-a0dd-0be64f73ba2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:18.878565 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1fc30bd8-8c43-4668-acd3-34f5e47f36b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:18.880133 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1fc30bd8-8c43-4668-acd3-34f5e47f36b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:18.886534 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1fc30bd8-8c43-4668-acd3-34f5e47f36b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:18.887260 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1fc30bd8-8c43-4668-acd3-34f5e47f36b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:18.888057 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1fc30bd8-8c43-4668-acd3-34f5e47f36b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:18.888488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1fc30bd8-8c43-4668-acd3-34f5e47f36b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:18.921415 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-428db718-a00d-4d8b-a0dd-0be64f73ba2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:18.929407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-428db718-a00d-4d8b-a0dd-0be64f73ba2e tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1521 microversion: 2.1 time: 0.175801 Jan 31 04:49:18.930103 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 278/581] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:18 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:19.076855 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1fc30bd8-8c43-4668-acd3-34f5e47f36b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:19.084315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1fc30bd8-8c43-4668-acd3-34f5e47f36b5 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1514 microversion: 2.1 time: 0.210061 Jan 31 04:49:19.085153 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 304/582] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:18 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:19.299489 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c0cd1c43-18fc-4ea1-bfde-3abb17e596a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:19.300108 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c0cd1c43-18fc-4ea1-bfde-3abb17e596a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:19.307886 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c0cd1c43-18fc-4ea1-bfde-3abb17e596a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:19.308334 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c0cd1c43-18fc-4ea1-bfde-3abb17e596a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:19.309124 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c0cd1c43-18fc-4ea1-bfde-3abb17e596a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:19.309559 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c0cd1c43-18fc-4ea1-bfde-3abb17e596a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:19.624552 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c0cd1c43-18fc-4ea1-bfde-3abb17e596a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:19.631923 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c0cd1c43-18fc-4ea1-bfde-3abb17e596a5 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.336763 Jan 31 04:49:19.632468 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 279/583] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:19 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:19.793809 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-58842c0a-56f9-4944-ae52-17666db87bb0 req-886aedec-d13b-4ac3-8190-cea503283e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81eea382-424b-4435-9241-e428592c98f3", "name": "network-vif-deleted", "tag": "4b0786d6-d423-4590-a58e-c6f508be4b8a"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:19.795366 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:19.795366 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:19.802439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-58842c0a-56f9-4944-ae52-17666db87bb0 req-886aedec-d13b-4ac3-8190-cea503283e3f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:19.803141 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-58842c0a-56f9-4944-ae52-17666db87bb0 req-886aedec-d13b-4ac3-8190-cea503283e3f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:19.813546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-58842c0a-56f9-4944-ae52-17666db87bb0 req-886aedec-d13b-4ac3-8190-cea503283e3f service nova] Creating event network-vif-deleted:4b0786d6-d423-4590-a58e-c6f508be4b8a for instance 81eea382-424b-4435-9241-e428592c98f3 on hv-cinder-82660 Jan 31 04:49:19.818456 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-58842c0a-56f9-4944-ae52-17666db87bb0 req-886aedec-d13b-4ac3-8190-cea503283e3f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028491 Jan 31 04:49:19.819047 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 305/584] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:49:19.948614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-78c71eb3-a2a4-4096-820f-c53a437595ff tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:19.949211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-78c71eb3-a2a4-4096-820f-c53a437595ff tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:19.955034 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-78c71eb3-a2a4-4096-820f-c53a437595ff tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:19.955519 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-78c71eb3-a2a4-4096-820f-c53a437595ff tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:19.956277 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-78c71eb3-a2a4-4096-820f-c53a437595ff tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:19.956704 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-78c71eb3-a2a4-4096-820f-c53a437595ff tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:20.019626 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-78c71eb3-a2a4-4096-820f-c53a437595ff tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25740a911eb440c2a81d4dbcbba95c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a785b6652097442291512fdd26f966ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:20.027090 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-78c71eb3-a2a4-4096-820f-c53a437595ff tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 200 len: 1307 microversion: 2.1 time: 0.084114 Jan 31 04:49:20.027648 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 280/585] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:19 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 1307 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:20.101666 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b109af4d-a0b6-4264-9ae9-a53e53539d82 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:20.102367 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b109af4d-a0b6-4264-9ae9-a53e53539d82 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:20.108614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b109af4d-a0b6-4264-9ae9-a53e53539d82 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:20.109063 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b109af4d-a0b6-4264-9ae9-a53e53539d82 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:20.109839 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b109af4d-a0b6-4264-9ae9-a53e53539d82 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:20.110276 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b109af4d-a0b6-4264-9ae9-a53e53539d82 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:20.251030 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b109af4d-a0b6-4264-9ae9-a53e53539d82 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:20.259082 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b109af4d-a0b6-4264-9ae9-a53e53539d82 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1514 microversion: 2.1 time: 0.160686 Jan 31 04:49:20.260078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 306/586] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:20 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:20.649465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0cf2591d-d137-4ef4-84ed-835d451feb73 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:20.650067 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0cf2591d-d137-4ef4-84ed-835d451feb73 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:20.656348 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cf2591d-d137-4ef4-84ed-835d451feb73 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:20.656785 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cf2591d-d137-4ef4-84ed-835d451feb73 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:20.657541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cf2591d-d137-4ef4-84ed-835d451feb73 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:20.657963 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cf2591d-d137-4ef4-84ed-835d451feb73 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:20.791365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0cf2591d-d137-4ef4-84ed-835d451feb73 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:20.798694 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0cf2591d-d137-4ef4-84ed-835d451feb73 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.153311 Jan 31 04:49:20.799287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 281/587] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:20 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:21.044139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:21.044668 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] [instance: 81eea382-424b-4435-9241-e428592c98f3] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:21.051152 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:21.051593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:21.052357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:21.052784 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:21.066509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] HTTP exception thrown: Instance 81eea382-424b-4435-9241-e428592c98f3 could not be found. Jan 31 04:49:21.067123 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] Returning 404 to user: Instance 81eea382-424b-4435-9241-e428592c98f3 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:21.067929 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c6aa53e4-3ff9-4379-9fff-dff503702753 tempest-ServerRescueNegativeTestJSON-766477777 tempest-ServerRescueNegativeTestJSON-766477777-project] 10.222.0.21 "GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3" status: 404 len: 111 microversion: 2.1 time: 0.028211 Jan 31 04:49:21.068461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 307/588] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:21 2022] GET /compute/v2.1/servers/81eea382-424b-4435-9241-e428592c98f3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:21.276961 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-585493a6-b49a-41b2-b1bd-b4945690b81d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:21.277716 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-585493a6-b49a-41b2-b1bd-b4945690b81d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:21.283637 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-585493a6-b49a-41b2-b1bd-b4945690b81d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:21.286611 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-585493a6-b49a-41b2-b1bd-b4945690b81d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:21.286611 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-585493a6-b49a-41b2-b1bd-b4945690b81d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:21.286611 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-585493a6-b49a-41b2-b1bd-b4945690b81d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:21.497708 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-585493a6-b49a-41b2-b1bd-b4945690b81d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:21.505281 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-585493a6-b49a-41b2-b1bd-b4945690b81d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1514 microversion: 2.1 time: 0.232821 Jan 31 04:49:21.505951 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 282/589] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:21 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:21.816231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-94dd52bc-0fba-461e-b67c-45f8e42be3d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:21.816830 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-94dd52bc-0fba-461e-b67c-45f8e42be3d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:21.824218 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-94dd52bc-0fba-461e-b67c-45f8e42be3d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:21.824732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-94dd52bc-0fba-461e-b67c-45f8e42be3d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:21.825734 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-94dd52bc-0fba-461e-b67c-45f8e42be3d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:21.826489 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-94dd52bc-0fba-461e-b67c-45f8e42be3d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:21.836379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-3680e6c8-9ea2-4047-8cc4-a4517b605d15 req-bc5d5e18-c64f-408d-a611-18adabcdf25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caeb7284-3cc9-4e25-8268-f4aa7eb66ab9", "name": "network-vif-deleted", "tag": "482834c2-7b2c-4fdc-aec2-6bf0968d1671"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:21.838727 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:21.838727 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:49:21.857449 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-3680e6c8-9ea2-4047-8cc4-a4517b605d15 req-bc5d5e18-c64f-408d-a611-18adabcdf25f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:21.857449 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-3680e6c8-9ea2-4047-8cc4-a4517b605d15 req-bc5d5e18-c64f-408d-a611-18adabcdf25f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:21.883028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-3680e6c8-9ea2-4047-8cc4-a4517b605d15 req-bc5d5e18-c64f-408d-a611-18adabcdf25f service nova] Creating event network-vif-deleted:482834c2-7b2c-4fdc-aec2-6bf0968d1671 for instance caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 on hv-cinder-82660 Jan 31 04:49:21.895263 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-3680e6c8-9ea2-4047-8cc4-a4517b605d15 req-bc5d5e18-c64f-408d-a611-18adabcdf25f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062652 Jan 31 04:49:21.896517 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 283/590] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:22.084398 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-94dd52bc-0fba-461e-b67c-45f8e42be3d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:22.096205 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-94dd52bc-0fba-461e-b67c-45f8e42be3d8 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.283537 Jan 31 04:49:22.096772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 308/591] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:21 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:22.529276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:22.529276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:22.532757 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:22.533202 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:22.533998 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:22.534469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:22.585688 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:22.586137 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:22.586665 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lazy-loading 'fault' on Instance uuid caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:49:22.634531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:22.642951 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-af57de04-2ad1-4c2d-a7c8-9afbb5484962 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 200 len: 1308 microversion: 2.1 time: 0.122162 Jan 31 04:49:22.647359 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 284/592] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:22 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 1308 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:23.113166 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-03aa12f1-4044-4e19-a6f4-4f898674b581 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:23.113772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-03aa12f1-4044-4e19-a6f4-4f898674b581 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:23.120649 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-03aa12f1-4044-4e19-a6f4-4f898674b581 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:23.121310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-03aa12f1-4044-4e19-a6f4-4f898674b581 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:23.122255 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-03aa12f1-4044-4e19-a6f4-4f898674b581 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:23.122693 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-03aa12f1-4044-4e19-a6f4-4f898674b581 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:23.315710 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-03aa12f1-4044-4e19-a6f4-4f898674b581 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:23.332288 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-03aa12f1-4044-4e19-a6f4-4f898674b581 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.222159 Jan 31 04:49:23.333966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 309/593] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:23 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:23.659681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:23.660282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: caeb7284-3cc9-4e25-8268-f4aa7eb66ab9] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:23.666673 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:23.667141 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:23.667893 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:23.668318 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:23.681437 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] HTTP exception thrown: Instance caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 could not be found. Jan 31 04:49:23.681989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Returning 404 to user: Instance caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:23.682841 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d2606c9e-0320-433c-af06-6799fe2448ea tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9" status: 404 len: 111 microversion: 2.1 time: 0.026823 Jan 31 04:49:23.683364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 285/594] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:23 2022] GET /compute/v2.1/servers/caeb7284-3cc9-4e25-8268-f4aa7eb66ab9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:24.350461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-807a486d-1447-4aa0-bea2-1b0e43da275d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:24.351183 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-807a486d-1447-4aa0-bea2-1b0e43da275d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:24.362872 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-807a486d-1447-4aa0-bea2-1b0e43da275d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:24.363544 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-807a486d-1447-4aa0-bea2-1b0e43da275d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:24.364525 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-807a486d-1447-4aa0-bea2-1b0e43da275d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:24.365131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-807a486d-1447-4aa0-bea2-1b0e43da275d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:24.622701 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-807a486d-1447-4aa0-bea2-1b0e43da275d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:24.631084 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-807a486d-1447-4aa0-bea2-1b0e43da275d tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.284208 Jan 31 04:49:24.641738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 310/595] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:24 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:24.945670 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2dfce20b-b87d-405c-b31e-e903adf916da tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:24.945670 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2dfce20b-b87d-405c-b31e-e903adf916da tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:24.949500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2dfce20b-b87d-405c-b31e-e903adf916da tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:24.950038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2dfce20b-b87d-405c-b31e-e903adf916da tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:24.951166 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2dfce20b-b87d-405c-b31e-e903adf916da tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:24.951676 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2dfce20b-b87d-405c-b31e-e903adf916da tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:24.978032 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2dfce20b-b87d-405c-b31e-e903adf916da tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:49:25.286553 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2dfce20b-b87d-405c-b31e-e903adf916da tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 204 len: 0 microversion: 2.1 time: 0.348676 Jan 31 04:49:25.287196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 286/596] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:49:24 2022] DELETE /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:49:25.295516 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0a57975d-e0fe-46ea-8c0f-3c0a5cadbe8d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:25.296121 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0a57975d-e0fe-46ea-8c0f-3c0a5cadbe8d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:25.302522 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0a57975d-e0fe-46ea-8c0f-3c0a5cadbe8d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:25.303004 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0a57975d-e0fe-46ea-8c0f-3c0a5cadbe8d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:25.303779 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0a57975d-e0fe-46ea-8c0f-3c0a5cadbe8d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:25.304215 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0a57975d-e0fe-46ea-8c0f-3c0a5cadbe8d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:25.453665 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0a57975d-e0fe-46ea-8c0f-3c0a5cadbe8d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:25.460988 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0a57975d-e0fe-46ea-8c0f-3c0a5cadbe8d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1513 microversion: 2.1 time: 0.169134 Jan 31 04:49:25.462110 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 311/597] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:25 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:25.650117 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c05a4422-3d22-4b76-b1d4-cbeb834c6a7c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:25.650871 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c05a4422-3d22-4b76-b1d4-cbeb834c6a7c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:25.656568 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c05a4422-3d22-4b76-b1d4-cbeb834c6a7c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:25.657013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c05a4422-3d22-4b76-b1d4-cbeb834c6a7c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:25.657783 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c05a4422-3d22-4b76-b1d4-cbeb834c6a7c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:25.658218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c05a4422-3d22-4b76-b1d4-cbeb834c6a7c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:25.793966 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c05a4422-3d22-4b76-b1d4-cbeb834c6a7c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:25.801045 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c05a4422-3d22-4b76-b1d4-cbeb834c6a7c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.155674 Jan 31 04:49:25.801598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 287/598] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:25 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:26.478028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7a284113-c257-4287-bdf2-00d790bcf49b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:26.478731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7a284113-c257-4287-bdf2-00d790bcf49b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:26.484987 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7a284113-c257-4287-bdf2-00d790bcf49b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:26.485434 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7a284113-c257-4287-bdf2-00d790bcf49b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:26.486213 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7a284113-c257-4287-bdf2-00d790bcf49b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:26.486645 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7a284113-c257-4287-bdf2-00d790bcf49b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:26.617663 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7a284113-c257-4287-bdf2-00d790bcf49b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:26.625015 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7a284113-c257-4287-bdf2-00d790bcf49b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1513 microversion: 2.1 time: 0.150830 Jan 31 04:49:26.625569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 312/599] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:26 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:26.817586 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8dd7cc6d-026a-4676-8544-ba4220e64d2f tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:26.818186 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8dd7cc6d-026a-4676-8544-ba4220e64d2f tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:26.825068 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8dd7cc6d-026a-4676-8544-ba4220e64d2f tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:26.825500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8dd7cc6d-026a-4676-8544-ba4220e64d2f tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:26.826262 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8dd7cc6d-026a-4676-8544-ba4220e64d2f tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:26.826686 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8dd7cc6d-026a-4676-8544-ba4220e64d2f tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:26.963040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8dd7cc6d-026a-4676-8544-ba4220e64d2f tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:26.971254 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8dd7cc6d-026a-4676-8544-ba4220e64d2f tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.157233 Jan 31 04:49:26.971831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 288/600] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:26 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:27.549113 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-4298fc79-3f5c-41e4-89e6-b00ea26fa71c req-bbecf25a-7a85-4a37-9bfd-aa61c92ef687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d20274-e8c9-4f5b-84d4-f12eac012abe", "name": "network-vif-plugged", "status": "completed", "tag": "69114b81-aa53-4115-81e1-c8240edf52b6"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:27.550935 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:27.550935 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:27.559354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-4298fc79-3f5c-41e4-89e6-b00ea26fa71c req-bbecf25a-7a85-4a37-9bfd-aa61c92ef687 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:27.559868 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-4298fc79-3f5c-41e4-89e6-b00ea26fa71c req-bbecf25a-7a85-4a37-9bfd-aa61c92ef687 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:27.573012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-4298fc79-3f5c-41e4-89e6-b00ea26fa71c req-bbecf25a-7a85-4a37-9bfd-aa61c92ef687 service nova] Creating event network-vif-plugged:69114b81-aa53-4115-81e1-c8240edf52b6 for instance 77d20274-e8c9-4f5b-84d4-f12eac012abe on hv-cinder-82660 Jan 31 04:49:27.576948 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-4298fc79-3f5c-41e4-89e6-b00ea26fa71c req-bbecf25a-7a85-4a37-9bfd-aa61c92ef687 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032835 Jan 31 04:49:27.577537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 313/601] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:27.645157 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-160b2868-9d79-4ef1-89c4-ee29fddf6b5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:27.646203 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-160b2868-9d79-4ef1-89c4-ee29fddf6b5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:27.659843 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-160b2868-9d79-4ef1-89c4-ee29fddf6b5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:27.660283 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-160b2868-9d79-4ef1-89c4-ee29fddf6b5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:27.661075 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-160b2868-9d79-4ef1-89c4-ee29fddf6b5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:27.661582 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-160b2868-9d79-4ef1-89c4-ee29fddf6b5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:27.903703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-160b2868-9d79-4ef1-89c4-ee29fddf6b5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:27.911550 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-160b2868-9d79-4ef1-89c4-ee29fddf6b5b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1513 microversion: 2.1 time: 0.270182 Jan 31 04:49:27.912119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 289/602] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:27 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:27.989886 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4fe2520a-7e2c-40be-9fd9-29550e1168c1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:27.990586 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4fe2520a-7e2c-40be-9fd9-29550e1168c1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:27.996794 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4fe2520a-7e2c-40be-9fd9-29550e1168c1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:27.997270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4fe2520a-7e2c-40be-9fd9-29550e1168c1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:27.998008 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4fe2520a-7e2c-40be-9fd9-29550e1168c1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:27.998433 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4fe2520a-7e2c-40be-9fd9-29550e1168c1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:28.141489 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4fe2520a-7e2c-40be-9fd9-29550e1168c1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:28.156884 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4fe2520a-7e2c-40be-9fd9-29550e1168c1 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.167198 Jan 31 04:49:28.156884 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 314/603] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:27 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:28.177316 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-cd78301c-bdab-4167-9a91-9fcda4599781 req-ed676373-8355-4a45-a696-ee26da5fddff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5466fd6b-2f35-4587-b100-45198d7240b1", "name": "network-vif-deleted", "tag": "265e7198-6b49-481d-a84d-30c9eb1994ac"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:28.178975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:28.178975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:49:28.186668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-cd78301c-bdab-4167-9a91-9fcda4599781 req-ed676373-8355-4a45-a696-ee26da5fddff service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:28.187132 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-cd78301c-bdab-4167-9a91-9fcda4599781 req-ed676373-8355-4a45-a696-ee26da5fddff service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:28.198924 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-cd78301c-bdab-4167-9a91-9fcda4599781 req-ed676373-8355-4a45-a696-ee26da5fddff service nova] Creating event network-vif-deleted:265e7198-6b49-481d-a84d-30c9eb1994ac for instance 5466fd6b-2f35-4587-b100-45198d7240b1 on hv-cinder-82660 Jan 31 04:49:28.203629 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-cd78301c-bdab-4167-9a91-9fcda4599781 req-ed676373-8355-4a45-a696-ee26da5fddff service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029939 Jan 31 04:49:28.204211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 290/604] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:28.927937 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:28.928918 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:28.935877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:28.936307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:28.937064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:28.937489 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:28.967435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:28.967898 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:28.968366 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lazy-loading 'fault' on Instance uuid 5466fd6b-2f35-4587-b100-45198d7240b1 {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:49:29.011632 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:29.018905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a3c766c5-ebd1-49ac-bf3e-34e7c15bb432 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 200 len: 1307 microversion: 2.1 time: 0.094952 Jan 31 04:49:29.019494 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 315/605] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:28 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:29.173597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-288ad49d-d7b8-4e72-baf7-9056669dab0c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:29.173597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-288ad49d-d7b8-4e72-baf7-9056669dab0c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:29.177594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-288ad49d-d7b8-4e72-baf7-9056669dab0c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:29.178040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-288ad49d-d7b8-4e72-baf7-9056669dab0c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:29.178834 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-288ad49d-d7b8-4e72-baf7-9056669dab0c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:29.179270 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-288ad49d-d7b8-4e72-baf7-9056669dab0c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:29.325867 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-288ad49d-d7b8-4e72-baf7-9056669dab0c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:29.333251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-288ad49d-d7b8-4e72-baf7-9056669dab0c tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1314 microversion: 2.1 time: 0.167004 Jan 31 04:49:29.333744 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 291/606] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:29 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:30.041650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:30.046276 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 5466fd6b-2f35-4587-b100-45198d7240b1] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:30.052482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:30.052970 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:30.053749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:30.054213 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:30.068428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] HTTP exception thrown: Instance 5466fd6b-2f35-4587-b100-45198d7240b1 could not be found. Jan 31 04:49:30.069011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Returning 404 to user: Instance 5466fd6b-2f35-4587-b100-45198d7240b1 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:30.069816 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-231d827a-6e81-45c3-a034-1f8681cea31f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1" status: 404 len: 111 microversion: 2.1 time: 0.032383 Jan 31 04:49:30.070344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 316/607] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:30 2022] GET /compute/v2.1/servers/5466fd6b-2f35-4587-b100-45198d7240b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:30.083249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-65c941bb-b196-422d-b133-8bce89a8a4f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:30.083825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-65c941bb-b196-422d-b133-8bce89a8a4f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:30.090726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c941bb-b196-422d-b133-8bce89a8a4f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:30.091420 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c941bb-b196-422d-b133-8bce89a8a4f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:30.092260 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c941bb-b196-422d-b133-8bce89a8a4f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:30.092803 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-65c941bb-b196-422d-b133-8bce89a8a4f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:30.118717 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-65c941bb-b196-422d-b133-8bce89a8a4f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:49:30.343352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-65c941bb-b196-422d-b133-8bce89a8a4f4 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 204 len: 0 microversion: 2.1 time: 0.263319 Jan 31 04:49:30.344006 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 292/608] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:49:30 2022] DELETE /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:49:30.349257 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-46b8da7e-16d5-49b8-a8df-cfdb69bf1b90 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:30.349866 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-46b8da7e-16d5-49b8-a8df-cfdb69bf1b90 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:30.352714 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f5145547-a5a3-419f-94b2-e03fa8ba3901 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:30.353416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f5145547-a5a3-419f-94b2-e03fa8ba3901 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:30.356595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-46b8da7e-16d5-49b8-a8df-cfdb69bf1b90 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:30.357032 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-46b8da7e-16d5-49b8-a8df-cfdb69bf1b90 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:30.358075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-46b8da7e-16d5-49b8-a8df-cfdb69bf1b90 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:30.358513 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-46b8da7e-16d5-49b8-a8df-cfdb69bf1b90 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:30.359599 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f5145547-a5a3-419f-94b2-e03fa8ba3901 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:30.360104 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f5145547-a5a3-419f-94b2-e03fa8ba3901 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:30.360800 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f5145547-a5a3-419f-94b2-e03fa8ba3901 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:30.361231 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f5145547-a5a3-419f-94b2-e03fa8ba3901 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:30.500642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f5145547-a5a3-419f-94b2-e03fa8ba3901 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:30.501709 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-46b8da7e-16d5-49b8-a8df-cfdb69bf1b90 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:30.509117 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f5145547-a5a3-419f-94b2-e03fa8ba3901 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1514 microversion: 2.1 time: 0.160817 Jan 31 04:49:30.509745 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 293/609] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:30 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:30.512916 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-46b8da7e-16d5-49b8-a8df-cfdb69bf1b90 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1498 microversion: 2.1 time: 0.167293 Jan 31 04:49:30.513580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 317/610] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:30 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:31.375809 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-95e50fe9-5538-46df-8287-821ef1c13871 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:31.376345 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-95e50fe9-5538-46df-8287-821ef1c13871 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:31.389698 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-95e50fe9-5538-46df-8287-821ef1c13871 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:31.389698 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-95e50fe9-5538-46df-8287-821ef1c13871 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:31.389698 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-95e50fe9-5538-46df-8287-821ef1c13871 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:31.389698 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-95e50fe9-5538-46df-8287-821ef1c13871 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:31.417583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-95e50fe9-5538-46df-8287-821ef1c13871 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:49:31.526253 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-bf621c0f-5494-4665-8237-d0f47108bc2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:31.527288 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-bf621c0f-5494-4665-8237-d0f47108bc2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:31.534031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bf621c0f-5494-4665-8237-d0f47108bc2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:31.534658 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bf621c0f-5494-4665-8237-d0f47108bc2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:31.535685 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bf621c0f-5494-4665-8237-d0f47108bc2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:31.536214 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bf621c0f-5494-4665-8237-d0f47108bc2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:31.674346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-95e50fe9-5538-46df-8287-821ef1c13871 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 204 len: 0 microversion: 2.1 time: 0.301894 Jan 31 04:49:31.675061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 294/611] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:49:31 2022] DELETE /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:49:31.684281 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6eef36c6-d317-4926-87c7-2fbbe36a1ddf tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:31.684752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6eef36c6-d317-4926-87c7-2fbbe36a1ddf tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:31.690678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6eef36c6-d317-4926-87c7-2fbbe36a1ddf tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:31.691158 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6eef36c6-d317-4926-87c7-2fbbe36a1ddf tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:31.691939 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6eef36c6-d317-4926-87c7-2fbbe36a1ddf tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:31.692379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6eef36c6-d317-4926-87c7-2fbbe36a1ddf tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:31.719439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-bf621c0f-5494-4665-8237-d0f47108bc2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:31.728564 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-bf621c0f-5494-4665-8237-d0f47108bc2e tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1514 microversion: 2.1 time: 0.206832 Jan 31 04:49:31.729247 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 318/612] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:31 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:31.891312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d4c10234-bdeb-4062-b3cf-d38cb1d2f6e7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:31.891757 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d4c10234-bdeb-4062-b3cf-d38cb1d2f6e7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:31.897994 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d4c10234-bdeb-4062-b3cf-d38cb1d2f6e7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:31.898430 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d4c10234-bdeb-4062-b3cf-d38cb1d2f6e7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:31.899946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d4c10234-bdeb-4062-b3cf-d38cb1d2f6e7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:31.900531 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d4c10234-bdeb-4062-b3cf-d38cb1d2f6e7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:31.911438 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6eef36c6-d317-4926-87c7-2fbbe36a1ddf tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:31.923614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6eef36c6-d317-4926-87c7-2fbbe36a1ddf tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1504 microversion: 2.1 time: 0.244150 Jan 31 04:49:31.934422 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 295/613] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:31 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:31.938241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-d4c10234-bdeb-4062-b3cf-d38cb1d2f6e7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lazy-loading 'flavor' on Instance uuid dde1517d-e13d-455c-a8dd-0119bb29148b {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:49:32.510567 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d4c10234-bdeb-4062-b3cf-d38cb1d2f6e7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/action" status: 202 len: 0 microversion: 2.20 time: 0.622890 Jan 31 04:49:32.514526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 319/614] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Jan 31 04:49:31 2022] POST /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 31 04:49:32.519704 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:32.521413 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:32.527377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:32.527827 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:32.528672 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:32.529038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:32.745596 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:32.754413 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:32.755523 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-71363b94-1033-431f-b436-748cb0f0693f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:32.756027 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:32.756928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-71363b94-1033-431f-b436-748cb0f0693f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:32.757061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ea85c04a-9558-452e-a7b1-5594f387bd90 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.241277 Jan 31 04:49:32.757579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 296/615] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:32 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:32.764681 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-71363b94-1033-431f-b436-748cb0f0693f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:32.768997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-71363b94-1033-431f-b436-748cb0f0693f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:32.768997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-71363b94-1033-431f-b436-748cb0f0693f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:32.768997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-71363b94-1033-431f-b436-748cb0f0693f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:32.941267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bdecd5ae-97ce-414f-8fcf-2ecc271d7ca6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:32.942027 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bdecd5ae-97ce-414f-8fcf-2ecc271d7ca6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:32.948191 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bdecd5ae-97ce-414f-8fcf-2ecc271d7ca6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:32.948729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bdecd5ae-97ce-414f-8fcf-2ecc271d7ca6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:32.949596 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bdecd5ae-97ce-414f-8fcf-2ecc271d7ca6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:32.950191 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bdecd5ae-97ce-414f-8fcf-2ecc271d7ca6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:32.973527 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-71363b94-1033-431f-b436-748cb0f0693f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:32.986616 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-71363b94-1033-431f-b436-748cb0f0693f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1514 microversion: 2.1 time: 0.234283 Jan 31 04:49:32.989275 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 320/616] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:32 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:33.111827 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-bdecd5ae-97ce-414f-8fcf-2ecc271d7ca6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:33.122064 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bdecd5ae-97ce-414f-8fcf-2ecc271d7ca6 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1504 microversion: 2.1 time: 0.184654 Jan 31 04:49:33.122858 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 297/617] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:32 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:33.236129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-aa544d0e-50b7-4833-bb98-3dbdb0d1d550 req-9d28c2c7-c3ec-449e-a2fa-553d57ea58b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7823379c-200c-4cff-9ff8-c3ce4c2462cd", "name": "network-vif-deleted", "tag": "dadcd049-61ea-4ff9-9b81-ff7ada3f3d65"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:33.236904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:33.236904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:33.249904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-aa544d0e-50b7-4833-bb98-3dbdb0d1d550 req-9d28c2c7-c3ec-449e-a2fa-553d57ea58b9 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:33.251350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-aa544d0e-50b7-4833-bb98-3dbdb0d1d550 req-9d28c2c7-c3ec-449e-a2fa-553d57ea58b9 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:33.264185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-aa544d0e-50b7-4833-bb98-3dbdb0d1d550 req-9d28c2c7-c3ec-449e-a2fa-553d57ea58b9 service nova] Creating event network-vif-deleted:dadcd049-61ea-4ff9-9b81-ff7ada3f3d65 for instance 7823379c-200c-4cff-9ff8-c3ce4c2462cd on hv-cinder-82660 Jan 31 04:49:33.269212 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-aa544d0e-50b7-4833-bb98-3dbdb0d1d550 req-9d28c2c7-c3ec-449e-a2fa-553d57ea58b9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037516 Jan 31 04:49:33.270979 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 321/618] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:33.775231 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:33.775826 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:33.782058 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:33.782498 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:33.783286 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:33.783708 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:33.929271 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:33.939646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:33.941854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:33.943175 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f1e776e5-76b4-473a-ac5c-74a764fe1499 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.171859 Jan 31 04:49:33.943812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 298/619] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:33 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:34.006184 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:34.007519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:34.017491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:34.017950 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:34.018742 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:34.019207 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:34.051967 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:34.052421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:34.052875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lazy-loading 'fault' on Instance uuid 7823379c-200c-4cff-9ff8-c3ce4c2462cd {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:49:34.103229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:34.114643 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-508541d6-3cbe-4413-9f1a-ec95c553e08d tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 200 len: 1307 microversion: 2.1 time: 0.114753 Jan 31 04:49:34.115833 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 322/620] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:33 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:34.139971 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3d01dfec-58dc-4b82-a8bd-5cef55481d7e tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:34.141049 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3d01dfec-58dc-4b82-a8bd-5cef55481d7e tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:34.148815 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d01dfec-58dc-4b82-a8bd-5cef55481d7e tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:34.149498 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d01dfec-58dc-4b82-a8bd-5cef55481d7e tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:34.150322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d01dfec-58dc-4b82-a8bd-5cef55481d7e tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:34.151011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d01dfec-58dc-4b82-a8bd-5cef55481d7e tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:34.371074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3d01dfec-58dc-4b82-a8bd-5cef55481d7e tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:34.379217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3d01dfec-58dc-4b82-a8bd-5cef55481d7e tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1504 microversion: 2.1 time: 0.243223 Jan 31 04:49:34.379829 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 299/621] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:34 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:34.969139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:34.969732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:34.975420 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:34.975863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:34.976622 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:34.977101 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.114725 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:35.123561 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:35.125223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:35.126400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-576a6df8-5c30-433a-80d8-113be9c08e71 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.161136 Jan 31 04:49:35.128572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 323/622] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:34 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:35.131634 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:35.132241 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: 7823379c-200c-4cff-9ff8-c3ce4c2462cd] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:35.139297 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:35.139994 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.140768 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:35.141199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.156191 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] HTTP exception thrown: Instance 7823379c-200c-4cff-9ff8-c3ce4c2462cd could not be found. Jan 31 04:49:35.156191 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Returning 404 to user: Instance 7823379c-200c-4cff-9ff8-c3ce4c2462cd could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:35.157160 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-71718c1c-e5b9-4682-8522-3b3999b4128f tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd" status: 404 len: 111 microversion: 2.1 time: 0.028691 Jan 31 04:49:35.161151 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 300/623] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:35 2022] GET /compute/v2.1/servers/7823379c-200c-4cff-9ff8-c3ce4c2462cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:35.288540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-2f76ea77-18f3-4de9-a18d-8e18406a5d99 req-39399acc-1548-4159-b150-4d04e55744e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d20274-e8c9-4f5b-84d4-f12eac012abe", "name": "network-vif-deleted", "tag": "69114b81-aa53-4115-81e1-c8240edf52b6"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:35.290649 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:35.290649 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:35.292930 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1873395300", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "4c106be3-7d30-4345-b394-72d02e51853a"}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:35.312750 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-2f76ea77-18f3-4de9-a18d-8e18406a5d99 req-39399acc-1548-4159-b150-4d04e55744e5 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:35.319060 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-2f76ea77-18f3-4de9-a18d-8e18406a5d99 req-39399acc-1548-4159-b150-4d04e55744e5 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.336448 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-2f76ea77-18f3-4de9-a18d-8e18406a5d99 req-39399acc-1548-4159-b150-4d04e55744e5 service nova] Creating event network-vif-deleted:69114b81-aa53-4115-81e1-c8240edf52b6 for instance 77d20274-e8c9-4f5b-84d4-f12eac012abe on hv-cinder-82660 Jan 31 04:49:35.345673 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-2f76ea77-18f3-4de9-a18d-8e18406a5d99 req-39399acc-1548-4159-b150-4d04e55744e5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060795 Jan 31 04:49:35.346020 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] validate_networks() for [('4c106be3-7d30-4345-b394-72d02e51853a', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:49:35.353376 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 324/624] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:35.400416 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:35.401486 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:35.408602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:35.409258 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.410227 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:35.410711 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.465824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:35.465824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.466235 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lazy-loading 'fault' on Instance uuid 77d20274-e8c9-4f5b-84d4-f12eac012abe {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:49:35.526051 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7557280caf846d6bdd96d80e1d28333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fced24126f40ac94f018df7c960a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:35.536313 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ea5044c7-82bd-47c8-9282-129519ed8903 tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 200 len: 1304 microversion: 2.1 time: 0.142565 Jan 31 04:49:35.540000 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 325/625] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:35 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:35.735694 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:49:35.736105 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:49:35.736574 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:49:35.736975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:49:35.737379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:49:35.746038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:35.746962 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.747294 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:35.747719 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:35.763492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Getting quotas for project 32bc488217794302b16e40a559bec3c8. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:49:35.767272 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Getting quotas for user 67b2e5f365144062bd2612f5d3ebd077 and project 32bc488217794302b16e40a559bec3c8. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:49:35.778196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:49:35.780483 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:49:35.937522 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f2a57a84-3483-4bb1-bfe0-23024923f3c3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649538 Jan 31 04:49:35.938401 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 301/626] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:49:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 04:49:35.948074 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-fe3ccfe9-c2f8-4dad-9ff4-e00372953947 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:35.948893 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-fe3ccfe9-c2f8-4dad-9ff4-e00372953947 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:36.002610 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fe3ccfe9-c2f8-4dad-9ff4-e00372953947 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:36.012628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-fe3ccfe9-c2f8-4dad-9ff4-e00372953947 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1219 microversion: 2.1 time: 0.068270 Jan 31 04:49:36.013214 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 326/627] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:35 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:36.145783 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:36.146416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:36.153436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:36.153958 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:36.154826 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:36.155419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:36.292648 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:36.300457 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:36.301943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:36.303104 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-299aa73e-1d3d-445e-8e37-2b383eb52255 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.161549 Jan 31 04:49:36.303650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 302/628] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:36 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:36.479203 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-539e3900-25db-40f9-bfbe-45f3f3dc946b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:36.483432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-539e3900-25db-40f9-bfbe-45f3f3dc946b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:36.485643 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-539e3900-25db-40f9-bfbe-45f3f3dc946b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:36.486087 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-539e3900-25db-40f9-bfbe-45f3f3dc946b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:36.486880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-539e3900-25db-40f9-bfbe-45f3f3dc946b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:36.487309 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-539e3900-25db-40f9-bfbe-45f3f3dc946b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:36.511739 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-539e3900-25db-40f9-bfbe-45f3f3dc946b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:49:36.553134 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:36.553721 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] [instance: 77d20274-e8c9-4f5b-84d4-f12eac012abe] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:36.559838 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:36.560285 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:36.561048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:36.561478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:36.574319 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] HTTP exception thrown: Instance 77d20274-e8c9-4f5b-84d4-f12eac012abe could not be found. Jan 31 04:49:36.574942 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] Returning 404 to user: Instance 77d20274-e8c9-4f5b-84d4-f12eac012abe could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:36.575739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b93bd101-d5f3-4754-82f8-29a1f34b0b8b tempest-VolumesActionsTest-1217228598 tempest-VolumesActionsTest-1217228598-project] 10.222.0.21 "GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe" status: 404 len: 111 microversion: 2.1 time: 0.026254 Jan 31 04:49:36.576249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 303/629] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:36 2022] GET /compute/v2.1/servers/77d20274-e8c9-4f5b-84d4-f12eac012abe => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 04:49:36.827298 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-539e3900-25db-40f9-bfbe-45f3f3dc946b tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "DELETE /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 204 len: 0 microversion: 2.1 time: 0.351311 Jan 31 04:49:36.833100 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 327/630] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:49:36 2022] DELETE /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:49:36.840172 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-37ad9cd2-f1a6-4c03-9024-78b266191886 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:36.841081 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-37ad9cd2-f1a6-4c03-9024-78b266191886 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:36.847751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-37ad9cd2-f1a6-4c03-9024-78b266191886 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:36.848187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-37ad9cd2-f1a6-4c03-9024-78b266191886 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:36.848945 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-37ad9cd2-f1a6-4c03-9024-78b266191886 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:36.849367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-37ad9cd2-f1a6-4c03-9024-78b266191886 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:36.983380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-37ad9cd2-f1a6-4c03-9024-78b266191886 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:36.990640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-37ad9cd2-f1a6-4c03-9024-78b266191886 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1514 microversion: 2.1 time: 0.154970 Jan 31 04:49:36.991246 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 304/631] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:36 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:37.035641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6bcc4917-1bde-4bcf-9339-309703684c61 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:37.035641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6bcc4917-1bde-4bcf-9339-309703684c61 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:37.041770 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6bcc4917-1bde-4bcf-9339-309703684c61 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:37.042070 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6bcc4917-1bde-4bcf-9339-309703684c61 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:37.042997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6bcc4917-1bde-4bcf-9339-309703684c61 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:37.043596 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6bcc4917-1bde-4bcf-9339-309703684c61 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:37.107040 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6bcc4917-1bde-4bcf-9339-309703684c61 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:37.114226 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6bcc4917-1bde-4bcf-9339-309703684c61 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1223 microversion: 2.1 time: 0.086691 Jan 31 04:49:37.114805 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 328/632] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:37 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:37.321344 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:37.323102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:37.330263 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:37.330953 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:37.331982 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:37.332414 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:37.471557 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:37.480193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:37.481672 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:37.482868 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-61dc8e92-fbcf-4e1d-94d8-33b84b59d094 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.165413 Jan 31 04:49:37.483469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 305/633] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:37 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:38.008145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6fe89cbc-b062-4e09-bd22-2aa221bd360a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:38.009379 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6fe89cbc-b062-4e09-bd22-2aa221bd360a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:38.015650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6fe89cbc-b062-4e09-bd22-2aa221bd360a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:38.015650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6fe89cbc-b062-4e09-bd22-2aa221bd360a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:38.016333 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6fe89cbc-b062-4e09-bd22-2aa221bd360a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:38.016940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6fe89cbc-b062-4e09-bd22-2aa221bd360a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:38.130899 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b121ed01-eeb8-4c8a-a106-5d4b74671388 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:38.131725 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b121ed01-eeb8-4c8a-a106-5d4b74671388 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:38.137910 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b121ed01-eeb8-4c8a-a106-5d4b74671388 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:38.138351 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b121ed01-eeb8-4c8a-a106-5d4b74671388 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:38.139447 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b121ed01-eeb8-4c8a-a106-5d4b74671388 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:38.139952 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b121ed01-eeb8-4c8a-a106-5d4b74671388 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:38.155848 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6fe89cbc-b062-4e09-bd22-2aa221bd360a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:38.163130 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6fe89cbc-b062-4e09-bd22-2aa221bd360a tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1514 microversion: 2.1 time: 0.159286 Jan 31 04:49:38.163693 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 329/634] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:38 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:38.200267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b121ed01-eeb8-4c8a-a106-5d4b74671388 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:38.207482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b121ed01-eeb8-4c8a-a106-5d4b74671388 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1271 microversion: 2.1 time: 0.080567 Jan 31 04:49:38.208037 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 306/635] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:38 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:38.500897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:38.501416 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:38.507650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:38.508590 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:38.509350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:38.509773 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:38.639572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:38.647189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:38.649262 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:38.650621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f5ceff4a-3fe4-4f49-afcc-5fd0ea60a8a9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.153459 Jan 31 04:49:38.651203 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 330/636] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:38 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:39.180856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-66487e5c-4f57-45a1-b3e2-b2e3c9da872c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:39.181396 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-66487e5c-4f57-45a1-b3e2-b2e3c9da872c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:39.187570 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66487e5c-4f57-45a1-b3e2-b2e3c9da872c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:39.188007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66487e5c-4f57-45a1-b3e2-b2e3c9da872c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:39.188761 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66487e5c-4f57-45a1-b3e2-b2e3c9da872c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:39.189186 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66487e5c-4f57-45a1-b3e2-b2e3c9da872c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:39.224814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8b2bf3d8-d67f-40e3-8208-fa770938c135 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:39.225448 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8b2bf3d8-d67f-40e3-8208-fa770938c135 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:39.232294 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b2bf3d8-d67f-40e3-8208-fa770938c135 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:39.232738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b2bf3d8-d67f-40e3-8208-fa770938c135 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:39.233512 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b2bf3d8-d67f-40e3-8208-fa770938c135 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:39.233943 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b2bf3d8-d67f-40e3-8208-fa770938c135 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:39.295653 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8b2bf3d8-d67f-40e3-8208-fa770938c135 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:39.302948 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8b2bf3d8-d67f-40e3-8208-fa770938c135 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1279 microversion: 2.1 time: 0.081548 Jan 31 04:49:39.303526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 331/637] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:39 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1279 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:39.322981 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-66487e5c-4f57-45a1-b3e2-b2e3c9da872c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:39.330299 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-66487e5c-4f57-45a1-b3e2-b2e3c9da872c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1514 microversion: 2.1 time: 0.153680 Jan 31 04:49:39.330867 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 307/638] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:39 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:39.668363 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:39.668960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:39.674728 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:39.675195 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:39.675951 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:39.676376 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:39.805365 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:39.813005 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:39.814462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:39.815615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7dce7431-15ca-476f-b5af-30459745f7bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.150857 Jan 31 04:49:39.816156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 332/639] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:39 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:40.321094 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6ae71f63-7f1f-409a-b363-b595dfd26dbe tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:40.321739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6ae71f63-7f1f-409a-b363-b595dfd26dbe tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:40.327924 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6ae71f63-7f1f-409a-b363-b595dfd26dbe tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:40.328395 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6ae71f63-7f1f-409a-b363-b595dfd26dbe tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:40.329183 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6ae71f63-7f1f-409a-b363-b595dfd26dbe tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:40.329607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6ae71f63-7f1f-409a-b363-b595dfd26dbe tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:40.347539 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-058a04fe-9489-4107-ab52-5f2f5b681a77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:40.348142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-058a04fe-9489-4107-ab52-5f2f5b681a77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:40.354996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-058a04fe-9489-4107-ab52-5f2f5b681a77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:40.355418 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-058a04fe-9489-4107-ab52-5f2f5b681a77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:40.356215 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-058a04fe-9489-4107-ab52-5f2f5b681a77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:40.356653 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-058a04fe-9489-4107-ab52-5f2f5b681a77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:40.395023 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6ae71f63-7f1f-409a-b363-b595dfd26dbe tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:40.402527 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6ae71f63-7f1f-409a-b363-b595dfd26dbe tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1279 microversion: 2.1 time: 0.085745 Jan 31 04:49:40.403271 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 308/640] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:40 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:40.488254 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-058a04fe-9489-4107-ab52-5f2f5b681a77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:40.496200 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-058a04fe-9489-4107-ab52-5f2f5b681a77 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1514 microversion: 2.1 time: 0.152324 Jan 31 04:49:40.496773 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 333/641] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:40 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:40.833525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:40.834046 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:40.840138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:40.840584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:40.841347 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:40.841776 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:40.968967 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:40.977288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:40.978805 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:40.979948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-92ce5a9f-cd32-4d1e-a602-17b6b8616297 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.150192 Jan 31 04:49:40.980529 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 309/642] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:40 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:41.419972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9ae9943e-10b7-4e5d-86ff-b47e22feabdc tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:41.420607 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9ae9943e-10b7-4e5d-86ff-b47e22feabdc tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:41.426691 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ae9943e-10b7-4e5d-86ff-b47e22feabdc tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:41.427159 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ae9943e-10b7-4e5d-86ff-b47e22feabdc tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:41.427917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ae9943e-10b7-4e5d-86ff-b47e22feabdc tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:41.428347 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ae9943e-10b7-4e5d-86ff-b47e22feabdc tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:41.486321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9ae9943e-10b7-4e5d-86ff-b47e22feabdc tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:41.493936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9ae9943e-10b7-4e5d-86ff-b47e22feabdc tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1289 microversion: 2.1 time: 0.077056 Jan 31 04:49:41.494602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 334/643] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:41 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:41.513697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8cad58d6-6faf-42be-bade-999b1746a54c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:41.514321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8cad58d6-6faf-42be-bade-999b1746a54c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:41.520455 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8cad58d6-6faf-42be-bade-999b1746a54c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:41.520889 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8cad58d6-6faf-42be-bade-999b1746a54c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:41.521643 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8cad58d6-6faf-42be-bade-999b1746a54c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:41.522062 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8cad58d6-6faf-42be-bade-999b1746a54c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:41.653041 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8cad58d6-6faf-42be-bade-999b1746a54c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:41.660049 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8cad58d6-6faf-42be-bade-999b1746a54c tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1514 microversion: 2.1 time: 0.149991 Jan 31 04:49:41.660597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 310/644] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:41 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:41.999741 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:42.000330 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:42.007259 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:42.010324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:42.010324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:42.010324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:42.271108 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:42.279796 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:42.281316 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:42.284357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0c1d46a4-e84e-46b4-a125-3411df84d289 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.286414 Jan 31 04:49:42.284357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 335/645] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:41 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:42.511678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7eb7d258-aecd-4ed6-a523-b06ce247970a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:42.512319 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7eb7d258-aecd-4ed6-a523-b06ce247970a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:42.518535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7eb7d258-aecd-4ed6-a523-b06ce247970a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:42.519127 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7eb7d258-aecd-4ed6-a523-b06ce247970a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:42.519764 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7eb7d258-aecd-4ed6-a523-b06ce247970a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:42.520193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7eb7d258-aecd-4ed6-a523-b06ce247970a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:42.579554 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7eb7d258-aecd-4ed6-a523-b06ce247970a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:42.586808 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7eb7d258-aecd-4ed6-a523-b06ce247970a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1277 microversion: 2.1 time: 0.079775 Jan 31 04:49:42.587441 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 311/646] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:42 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:42.677021 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a8883920-4c4f-4bdf-9853-0f31c11835f8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:42.677464 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a8883920-4c4f-4bdf-9853-0f31c11835f8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:42.684424 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8883920-4c4f-4bdf-9853-0f31c11835f8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:42.684868 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8883920-4c4f-4bdf-9853-0f31c11835f8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:42.685645 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8883920-4c4f-4bdf-9853-0f31c11835f8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:42.686077 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8883920-4c4f-4bdf-9853-0f31c11835f8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:42.838554 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a8883920-4c4f-4bdf-9853-0f31c11835f8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:42.846222 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a8883920-4c4f-4bdf-9853-0f31c11835f8 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1514 microversion: 2.1 time: 0.173906 Jan 31 04:49:42.856230 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 336/647] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:42 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:43.300904 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:43.301823 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:43.308642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:43.309463 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:43.310446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:43.311092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:43.529377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:43.537268 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:43.538753 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:43.540642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-606ccd15-3753-440f-bc3f-242f5890603b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.242830 Jan 31 04:49:43.546416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 312/648] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:43 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:43.609552 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-341a37c7-9725-4772-b796-fa833b477e7a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:43.609552 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-341a37c7-9725-4772-b796-fa833b477e7a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:43.623444 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-374a7b14-0413-422a-87ab-5f3c350257c7 req-5b0e69df-8ca9-4d8a-8e03-dafa88d75afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb76b92c-8a69-4296-ac1a-e92639dfc36d", "tag": "a9fc9791-5ebe-4263-9f37-63c51001fb39"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:43.626156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-341a37c7-9725-4772-b796-fa833b477e7a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:43.626537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-341a37c7-9725-4772-b796-fa833b477e7a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:43.627654 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-341a37c7-9725-4772-b796-fa833b477e7a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:43.628243 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-341a37c7-9725-4772-b796-fa833b477e7a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:43.636483 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:43.636483 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:49:43.646261 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-374a7b14-0413-422a-87ab-5f3c350257c7 req-5b0e69df-8ca9-4d8a-8e03-dafa88d75afa service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:43.646880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-374a7b14-0413-422a-87ab-5f3c350257c7 req-5b0e69df-8ca9-4d8a-8e03-dafa88d75afa service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:43.659902 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-374a7b14-0413-422a-87ab-5f3c350257c7 req-5b0e69df-8ca9-4d8a-8e03-dafa88d75afa service nova] Creating event network-changed:a9fc9791-5ebe-4263-9f37-63c51001fb39 for instance eb76b92c-8a69-4296-ac1a-e92639dfc36d on hv-cinder-82660 Jan 31 04:49:43.665729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-374a7b14-0413-422a-87ab-5f3c350257c7 req-5b0e69df-8ca9-4d8a-8e03-dafa88d75afa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050528 Jan 31 04:49:43.666507 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 313/649] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:43.814350 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-d057be37-e0bf-4707-a061-fbf1cfdf70d5 req-d4fa402a-cd02-4806-ad49-12ecc6e8fd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9c56db-f2a0-485f-83e4-bc1b8b9172cf", "name": "network-vif-deleted", "tag": "349870cb-d883-4ba5-862f-01f28757a4f8"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:43.816021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:43.816021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:49:43.818411 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-341a37c7-9725-4772-b796-fa833b477e7a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:43.825877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-341a37c7-9725-4772-b796-fa833b477e7a tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.224378 Jan 31 04:49:43.826453 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-d057be37-e0bf-4707-a061-fbf1cfdf70d5 req-d4fa402a-cd02-4806-ad49-12ecc6e8fd65 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:43.826979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-d057be37-e0bf-4707-a061-fbf1cfdf70d5 req-d4fa402a-cd02-4806-ad49-12ecc6e8fd65 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:43.835328 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 337/650] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:43 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:43.839448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-d057be37-e0bf-4707-a061-fbf1cfdf70d5 req-d4fa402a-cd02-4806-ad49-12ecc6e8fd65 service nova] Creating event network-vif-deleted:349870cb-d883-4ba5-862f-01f28757a4f8 for instance dd9c56db-f2a0-485f-83e4-bc1b8b9172cf on hv-cinder-82660 Jan 31 04:49:43.844553 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-d057be37-e0bf-4707-a061-fbf1cfdf70d5 req-d4fa402a-cd02-4806-ad49-12ecc6e8fd65 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039339 Jan 31 04:49:43.845395 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 314/651] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:43.863325 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c75458a2-a61c-405d-a066-d03f7c21c3b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:43.863981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c75458a2-a61c-405d-a066-d03f7c21c3b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:43.870661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c75458a2-a61c-405d-a066-d03f7c21c3b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:43.871419 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c75458a2-a61c-405d-a066-d03f7c21c3b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:43.872447 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c75458a2-a61c-405d-a066-d03f7c21c3b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:43.872935 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c75458a2-a61c-405d-a066-d03f7c21c3b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:43.946115 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c75458a2-a61c-405d-a066-d03f7c21c3b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:43.959190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c75458a2-a61c-405d-a066-d03f7c21c3b2 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1472 microversion: 2.1 time: 0.099393 Jan 31 04:49:43.959758 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 338/652] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:43 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1472 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:44.564112 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:44.564984 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:44.582236 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:44.582711 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:44.583512 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:44.590755 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:44.764658 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:44.773287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:44.775928 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:44.777351 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6856439c-fc00-4e55-9e74-5323d3bede64 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.221727 Jan 31 04:49:44.778076 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 315/653] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:44 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:44.847460 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-43912635-03aa-485c-8506-ca64a9a781c7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:44.849665 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-43912635-03aa-485c-8506-ca64a9a781c7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:44.873724 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43912635-03aa-485c-8506-ca64a9a781c7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:44.874944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43912635-03aa-485c-8506-ca64a9a781c7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:44.877908 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43912635-03aa-485c-8506-ca64a9a781c7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:44.882777 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-43912635-03aa-485c-8506-ca64a9a781c7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:44.979363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:44.980807 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:44.990405 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:44.991518 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:44.993697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:44.994545 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:45.057324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:45.057854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:45.058628 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lazy-loading 'fault' on Instance uuid dd9c56db-f2a0-485f-83e4-bc1b8b9172cf {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:49:45.260075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-43912635-03aa-485c-8506-ca64a9a781c7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:45.284097 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-43912635-03aa-485c-8506-ca64a9a781c7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.443556 Jan 31 04:49:45.360347 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 339/654] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:44 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:45.583985 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6f7f126c2a4cbe80f029f352c4cafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41828fbc91c740cfbec65e04e92a4ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:45.602553 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4d129d99-13e8-44c7-8032-d8e188a42142 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 200 len: 1308 microversion: 2.1 time: 0.629445 Jan 31 04:49:45.605748 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 316/655] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:44 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 1308 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:45.797423 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:45.798039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:45.804310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:45.806814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:45.807781 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:45.808507 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:45.959389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:45.969504 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:45.971635 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:45.992651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-27e484c6-8fba-4a6d-8930-fbeebfb3b776 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.181159 Jan 31 04:49:45.995905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 340/656] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:45 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:46.317047 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cf5a7e65-6649-44df-8ce6-26cec855a117 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:46.317917 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cf5a7e65-6649-44df-8ce6-26cec855a117 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:46.324646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf5a7e65-6649-44df-8ce6-26cec855a117 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:46.325260 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf5a7e65-6649-44df-8ce6-26cec855a117 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:46.326262 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf5a7e65-6649-44df-8ce6-26cec855a117 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:46.326697 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf5a7e65-6649-44df-8ce6-26cec855a117 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:46.551520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cf5a7e65-6649-44df-8ce6-26cec855a117 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:46.560270 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cf5a7e65-6649-44df-8ce6-26cec855a117 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.247188 Jan 31 04:49:46.570497 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 317/657] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:46 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:46.621613 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:46.622352 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] [instance: dd9c56db-f2a0-485f-83e4-bc1b8b9172cf] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:46.629114 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:46.629559 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:46.630599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:46.631299 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:46.646570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] HTTP exception thrown: Instance dd9c56db-f2a0-485f-83e4-bc1b8b9172cf could not be found. Jan 31 04:49:46.647181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] Returning 404 to user: Instance dd9c56db-f2a0-485f-83e4-bc1b8b9172cf could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:46.647996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-548ebf33-81a9-4069-8479-cbc39f72ac97 tempest-AttachVolumeNegativeTest-1010736181 tempest-AttachVolumeNegativeTest-1010736181-project] 10.222.0.21 "GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf" status: 404 len: 111 microversion: 2.1 time: 0.030340 Jan 31 04:49:46.648522 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 341/658] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:46 2022] GET /compute/v2.1/servers/dd9c56db-f2a0-485f-83e4-bc1b8b9172cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:47.003993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:47.006535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:47.017880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:47.017995 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:47.018711 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:47.019164 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:47.170296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:47.178347 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:47.180213 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:47.182071 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-896634e3-b71d-4f8a-826f-70aed240fce7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.183527 Jan 31 04:49:47.182883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 318/659] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:46 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:47.578094 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4149a77c-0d6f-4baf-ac10-880a36a9d461 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:47.578881 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4149a77c-0d6f-4baf-ac10-880a36a9d461 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:47.587713 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4149a77c-0d6f-4baf-ac10-880a36a9d461 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:47.588458 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4149a77c-0d6f-4baf-ac10-880a36a9d461 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:47.589600 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4149a77c-0d6f-4baf-ac10-880a36a9d461 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:47.590234 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4149a77c-0d6f-4baf-ac10-880a36a9d461 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:47.756076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4149a77c-0d6f-4baf-ac10-880a36a9d461 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:47.763102 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4149a77c-0d6f-4baf-ac10-880a36a9d461 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.188434 Jan 31 04:49:47.763674 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 342/660] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:47 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:48.200011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:48.200619 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:48.209454 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:48.210991 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:48.213419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:48.214080 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:48.416701 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:48.426657 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:48.431546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:48.437398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-394c48bc-c3ce-4ad6-96e8-b58a44de0c3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.241368 Jan 31 04:49:48.438533 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 319/661] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:48 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:48.779760 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-dcb27904-8c7a-4318-b370-0726000ee3a4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:48.780964 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-dcb27904-8c7a-4318-b370-0726000ee3a4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:48.788801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dcb27904-8c7a-4318-b370-0726000ee3a4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:48.792547 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dcb27904-8c7a-4318-b370-0726000ee3a4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:48.793535 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dcb27904-8c7a-4318-b370-0726000ee3a4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:48.795467 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dcb27904-8c7a-4318-b370-0726000ee3a4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:48.987344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dcb27904-8c7a-4318-b370-0726000ee3a4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:48.997789 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-dcb27904-8c7a-4318-b370-0726000ee3a4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.221610 Jan 31 04:49:49.009125 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 343/662] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:48 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:49.455940 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:49.457166 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:49.464232 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:49.468005 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:49.468005 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:49.468005 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:49.629646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:49.640609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:49.645837 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:49.647051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7fb97b4e-281f-4fb6-ab34-6da280cdc95c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1743 microversion: 2.20 time: 0.194919 Jan 31 04:49:49.648083 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 320/663] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:49 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1743 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:49.729373 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4a073e7b-c769-475c-8936-fa2fdb223f16 tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] Action: 'create', calling method: .version_select at 0x7f69f4c2f0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-396529425", "metadata": {"Type": "work"}}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:50.017198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-dc1d2cdb-38a4-4f27-b17f-a4d9a625fa5e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:50.018296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-dc1d2cdb-38a4-4f27-b17f-a4d9a625fa5e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:50.025559 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dc1d2cdb-38a4-4f27-b17f-a4d9a625fa5e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:50.030469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dc1d2cdb-38a4-4f27-b17f-a4d9a625fa5e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:50.030469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dc1d2cdb-38a4-4f27-b17f-a4d9a625fa5e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:50.030469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dc1d2cdb-38a4-4f27-b17f-a4d9a625fa5e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:50.202095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-dc1d2cdb-38a4-4f27-b17f-a4d9a625fa5e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:50.211382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-dc1d2cdb-38a4-4f27-b17f-a4d9a625fa5e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.199051 Jan 31 04:49:50.226106 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 321/664] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:50 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:50.564849 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4a073e7b-c769-475c-8936-fa2fdb223f16 tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.006649 Jan 31 04:49:50.566543 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 344/665] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Jan 31 04:49:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1010 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 31 04:49:50.586784 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f1de7e7d-5f52-4b15-b24e-fe2a384fce0f tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] Calling method '.version_select at 0x7f69f533c820>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:50.670943 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:50.671824 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:50.677025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f1de7e7d-5f52-4b15-b24e-fe2a384fce0f tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57" status: 200 len: 352 microversion: 2.1 time: 0.103245 Jan 31 04:49:50.680416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 322/666] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:49:50 2022] GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:49:50.688219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:50.689390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:50.690357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:50.690809 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:50.852226 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:50.865565 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:50.867156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:50.869979 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-35606558-6cae-4853-ba7e-a28bcff631e8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1743 microversion: 2.20 time: 0.202827 Jan 31 04:49:50.871028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 345/667] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:50 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:51.238779 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0ddd8571-5e76-4b6d-b5eb-d1da640bc109 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:51.239431 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0ddd8571-5e76-4b6d-b5eb-d1da640bc109 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:51.245937 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0ddd8571-5e76-4b6d-b5eb-d1da640bc109 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:51.246501 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0ddd8571-5e76-4b6d-b5eb-d1da640bc109 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:51.247683 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0ddd8571-5e76-4b6d-b5eb-d1da640bc109 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:51.248282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0ddd8571-5e76-4b6d-b5eb-d1da640bc109 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:51.403122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0ddd8571-5e76-4b6d-b5eb-d1da640bc109 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:51.411357 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0ddd8571-5e76-4b6d-b5eb-d1da640bc109 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.176127 Jan 31 04:49:51.413017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 323/668] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:51 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:51.690589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-71b48e63-584f-4753-b30c-a88b7e5121bb tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] Calling method '.version_select at 0x7f69f4b439d0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:51.737949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-71b48e63-584f-4753-b30c-a88b7e5121bb tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57" status: 200 len: 353 microversion: 2.1 time: 0.050774 Jan 31 04:49:51.745679 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 346/669] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:49:51 2022] GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:51.751315 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-fc4cfa20-9666-491f-8a86-9fb8dbcbe47b tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] Calling method '.version_select at 0x7f69f5425d30>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:51.813719 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-fc4cfa20-9666-491f-8a86-9fb8dbcbe47b tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57" status: 200 len: 353 microversion: 2.1 time: 0.066552 Jan 31 04:49:51.814867 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 324/670] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:49:51 2022] GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:51.832080 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-da41ee40-cdfe-43e7-98db-a1420cf2829d tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] Calling method '.version_select at 0x7f69f4cb09d0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:51.891011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:51.892496 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:51.907525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:51.907525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:51.907525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:51.907525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:52.003353 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-da41ee40-cdfe-43e7-98db-a1420cf2829d tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57" status: 202 len: 0 microversion: 2.1 time: 0.174669 Jan 31 04:49:52.008231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 347/671] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Jan 31 04:49:51 2022] DELETE /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:49:52.015350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-89f920b6-ebd0-4efe-ab3f-552ba18afe12 req-f6099cb5-1bd0-4068-8c16-f182ccf2656e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb76b92c-8a69-4296-ac1a-e92639dfc36d", "name": "network-vif-plugged", "status": "completed", "tag": "a9fc9791-5ebe-4263-9f37-63c51001fb39"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:52.019118 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:52.019118 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:52.043490 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-89f920b6-ebd0-4efe-ab3f-552ba18afe12 req-f6099cb5-1bd0-4068-8c16-f182ccf2656e service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:52.044251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-89f920b6-ebd0-4efe-ab3f-552ba18afe12 req-f6099cb5-1bd0-4068-8c16-f182ccf2656e service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:52.058897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-89f920b6-ebd0-4efe-ab3f-552ba18afe12 req-f6099cb5-1bd0-4068-8c16-f182ccf2656e service nova] Creating event network-vif-plugged:a9fc9791-5ebe-4263-9f37-63c51001fb39 for instance eb76b92c-8a69-4296-ac1a-e92639dfc36d on hv-cinder-82660 Jan 31 04:49:52.069542 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-89f920b6-ebd0-4efe-ab3f-552ba18afe12 req-f6099cb5-1bd0-4068-8c16-f182ccf2656e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059114 Jan 31 04:49:52.074265 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 348/672] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:52.077596 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8b55a880-73b9-413b-9d36-6b4f7945b233 tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] Calling method '.version_select at 0x7f69f4bc29d0>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:52.116805 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:52.128564 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:52.131341 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:52.132713 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-054f7417-92a2-4663-a321-dd5dc1035156 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1743 microversion: 2.20 time: 0.247421 Jan 31 04:49:52.133855 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 325/673] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:51 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:52.150619 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8b55a880-73b9-413b-9d36-6b4f7945b233 tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57" status: 200 len: 352 microversion: 2.1 time: 0.078632 Jan 31 04:49:52.151681 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 349/674] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:49:52 2022] GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57 => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:52.433942 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8f35bb27-4e35-4703-89e1-b4a1684512ea tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:52.434851 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8f35bb27-4e35-4703-89e1-b4a1684512ea tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:52.440974 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f35bb27-4e35-4703-89e1-b4a1684512ea tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:52.441635 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f35bb27-4e35-4703-89e1-b4a1684512ea tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:52.442573 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f35bb27-4e35-4703-89e1-b4a1684512ea tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:52.443348 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f35bb27-4e35-4703-89e1-b4a1684512ea tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:52.637922 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8f35bb27-4e35-4703-89e1-b4a1684512ea tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:52.646513 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8f35bb27-4e35-4703-89e1-b4a1684512ea tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.216367 Jan 31 04:49:52.657081 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 326/675] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:52 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:53.154013 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:53.155399 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:53.162715 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:53.163281 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-af0ff3a6-78dc-4f65-9063-28c343b0f6c8 tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] Calling method '.version_select at 0x7f69f538d670>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:53.164095 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:53.165431 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:53.166164 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:53.207130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-af0ff3a6-78dc-4f65-9063-28c343b0f6c8 tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] HTTP exception thrown: Volume 2995a11c-005f-412b-a561-d1300e5d7c57 could not be found. Jan 31 04:49:53.207985 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-af0ff3a6-78dc-4f65-9063-28c343b0f6c8 tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] Returning 404 to user: Volume 2995a11c-005f-412b-a561-d1300e5d7c57 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:49:53.209018 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-af0ff3a6-78dc-4f65-9063-28c343b0f6c8 tempest-VolumesGetTestJSON-1394058102 tempest-VolumesGetTestJSON-1394058102-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57" status: 404 len: 109 microversion: 2.1 time: 0.049866 Jan 31 04:49:53.213635 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 327/676] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Jan 31 04:49:53 2022] GET /compute/v2.1/os-volumes/2995a11c-005f-412b-a561-d1300e5d7c57 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:53.340231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:53.352673 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:53.355090 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:53.357574 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8a1d1f10-2f7c-4f44-a64f-00aaf93d6137 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1743 microversion: 2.20 time: 0.210851 Jan 31 04:49:53.358402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 350/677] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:53 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1743 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:53.666641 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-87e5301c-e8c4-4e29-b8e2-a93712f4ac4e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:53.667610 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-87e5301c-e8c4-4e29-b8e2-a93712f4ac4e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:53.699972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-87e5301c-e8c4-4e29-b8e2-a93712f4ac4e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:53.699972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-87e5301c-e8c4-4e29-b8e2-a93712f4ac4e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:53.699972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-87e5301c-e8c4-4e29-b8e2-a93712f4ac4e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:53.699972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-87e5301c-e8c4-4e29-b8e2-a93712f4ac4e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:53.841329 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-87e5301c-e8c4-4e29-b8e2-a93712f4ac4e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:53.848619 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-87e5301c-e8c4-4e29-b8e2-a93712f4ac4e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1319 microversion: 2.1 time: 0.188450 Jan 31 04:49:53.849108 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 328/678] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:53 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:49:54.104278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-19b72473-8466-4b46-a129-725f8037a65e req-cbaeff27-b580-4d40-a648-80efc2ca50a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde1517d-e13d-455c-a8dd-0119bb29148b", "name": "network-vif-plugged", "status": "completed", "tag": "2eade66b-918f-4c8e-a64c-60d0ce7921a5"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:54.104278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:49:54.104278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:49:54.111780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-19b72473-8466-4b46-a129-725f8037a65e req-cbaeff27-b580-4d40-a648-80efc2ca50a3 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:54.112433 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-19b72473-8466-4b46-a129-725f8037a65e req-cbaeff27-b580-4d40-a648-80efc2ca50a3 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:54.125551 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-19b72473-8466-4b46-a129-725f8037a65e req-cbaeff27-b580-4d40-a648-80efc2ca50a3 service nova] Creating event network-vif-plugged:2eade66b-918f-4c8e-a64c-60d0ce7921a5 for instance dde1517d-e13d-455c-a8dd-0119bb29148b on hv-cinder-82660 Jan 31 04:49:54.132707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-19b72473-8466-4b46-a129-725f8037a65e req-cbaeff27-b580-4d40-a648-80efc2ca50a3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033224 Jan 31 04:49:54.136767 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 351/679] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:54.377584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:54.379658 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:54.393475 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:54.394304 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:54.395286 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:54.396737 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:54.630639 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:54.640081 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:54.642431 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:54.649147 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1ecfd3a6-617b-4b70-a58a-b4b3ab2c9835 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1743 microversion: 2.20 time: 0.273265 Jan 31 04:49:54.649147 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 329/680] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:54 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1743 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:54.865768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-41d2ebb0-2fcd-4623-aebd-b5e3ee64d260 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:54.867159 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-41d2ebb0-2fcd-4623-aebd-b5e3ee64d260 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:54.874471 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-41d2ebb0-2fcd-4623-aebd-b5e3ee64d260 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:54.876929 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-41d2ebb0-2fcd-4623-aebd-b5e3ee64d260 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:54.876929 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-41d2ebb0-2fcd-4623-aebd-b5e3ee64d260 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:54.876929 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-41d2ebb0-2fcd-4623-aebd-b5e3ee64d260 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:55.045480 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-41d2ebb0-2fcd-4623-aebd-b5e3ee64d260 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:55.055124 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-41d2ebb0-2fcd-4623-aebd-b5e3ee64d260 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1508 microversion: 2.1 time: 0.192087 Jan 31 04:49:55.055124 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 352/681] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:49:54 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:49:55.664328 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:55.666310 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:55.672376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:55.672820 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:55.674778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:55.675250 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:55.941974 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:55.983084 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:55.987293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:55.993102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e60323a8-ae95-48aa-b70b-71a393aee477 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1743 microversion: 2.20 time: 0.331598 Jan 31 04:49:56.011582 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 330/682] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:55 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1743 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:57.013049 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:57.013654 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:57.020991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:57.021626 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:57.022567 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:57.023241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:57.213119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:57.213119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:57.213971 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:57.213971 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8c116496-7c5f-4d44-a49e-0d90ee19e38d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.204632 Jan 31 04:49:57.213971 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 353/683] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:57 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:57.679874 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3eff013c-aee8-44fe-a608-2842f4bca0f2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98a39f50-228d-473f-838f-208b9d06fda7"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:49:57.682079 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3eff013c-aee8-44fe-a608-2842f4bca0f2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:57.693213 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3eff013c-aee8-44fe-a608-2842f4bca0f2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:57.697215 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3eff013c-aee8-44fe-a608-2842f4bca0f2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:57.698224 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3eff013c-aee8-44fe-a608-2842f4bca0f2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:57.698640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3eff013c-aee8-44fe-a608-2842f4bca0f2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:58.232287 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:58.233545 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:58.248926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:58.249664 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:58.250644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:58.251259 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:58.598841 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3eff013c-aee8-44fe-a608-2842f4bca0f2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923518 Jan 31 04:49:58.604775 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 331/684] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:49:57 2022] POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/os-volume_attachments => generated 194 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:49:58.722531 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:58.734228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:58.737178 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:49:58.739111 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4911a460-9bf2-4600-9e53-81dfc86800f1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.511493 Jan 31 04:49:58.740301 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 354/685] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:58 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:49:59.828122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:49:59.828122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:49:59.828122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:59.828122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:49:59.829056 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:49:59.829056 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:00.251459 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:00.263907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:00.291952 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:00.299405 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1e70f571-6cbd-4039-9772-ace6d38325ec tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.493009 Jan 31 04:50:00.300289 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 332/686] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:49:59 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:01.337444 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:01.339288 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:01.359498 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:01.361280 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:01.362709 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:01.363415 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:01.556739 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:01.568314 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:01.568314 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:01.568314 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8ed237dc-d444-437e-9d31-c3d3ba117be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.246769 Jan 31 04:50:01.568759 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 355/687] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:01 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:02.594046 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:02.596942 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:02.624724 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:02.630926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:02.635192 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:02.643437 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:02.943111 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:02.954898 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:02.957845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:02.964465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9493e064-638d-4728-a477-bdc8115cd8ff tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.379447 Jan 31 04:50:02.976624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 333/688] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:02 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:03.980701 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:03.982045 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:03.997401 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:04.001742 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:04.003176 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:04.006258 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:04.232005 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:04.241834 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:04.243821 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:04.245892 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-22bae335-e18e-40f5-bceb-5c6287e1d9ae tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.269399 Jan 31 04:50:04.246593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 356/689] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:03 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:05.269643 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:05.270221 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:05.277133 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:05.277823 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:05.278899 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:05.279925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:05.494522 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:05.518910 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:05.520691 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:05.522620 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d1fa81f9-5e69-4320-be99-6eebace4cbf5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.257020 Jan 31 04:50:05.524965 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 334/690] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:05 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:06.549701 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:06.552906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:06.560523 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:06.561121 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:06.562320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:06.562751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:06.759718 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:06.770610 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:06.773099 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:06.774977 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2053984b-2969-4375-ac06-84fc91f96b3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.228959 Jan 31 04:50:06.776393 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 357/691] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:06 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:07.793887 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:07.794706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:07.802705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:07.803240 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:07.804681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:07.805838 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:07.874972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9b28bba9-2921-41d7-b982-ecb4869b9938 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:50:07.881608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9b28bba9-2921-41d7-b982-ecb4869b9938 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:07.883360 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9b28bba9-2921-41d7-b982-ecb4869b9938 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:07.958019 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9b28bba9-2921-41d7-b982-ecb4869b9938 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Going to try to stop instance {{(pid=123368) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 31 04:50:08.012787 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:08.021153 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:08.022911 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:08.024754 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c75f62f2-c446-4790-a0a5-5e9373b3f90b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.235256 Jan 31 04:50:08.025818 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 335/692] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:07 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:08.158346 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9b28bba9-2921-41d7-b982-ecb4869b9938 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/action" status: 202 len: 0 microversion: 2.1 time: 0.288072 Jan 31 04:50:08.159783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 358/693] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:50:07 2022] POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 04:50:08.168067 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c8f524d6-0fee-46ad-8c72-8fdafb916aa7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:08.168653 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c8f524d6-0fee-46ad-8c72-8fdafb916aa7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:08.174882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c8f524d6-0fee-46ad-8c72-8fdafb916aa7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:08.175835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c8f524d6-0fee-46ad-8c72-8fdafb916aa7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:08.176773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c8f524d6-0fee-46ad-8c72-8fdafb916aa7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:08.177532 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c8f524d6-0fee-46ad-8c72-8fdafb916aa7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:08.388210 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c8f524d6-0fee-46ad-8c72-8fdafb916aa7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:08.396731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c8f524d6-0fee-46ad-8c72-8fdafb916aa7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.232793 Jan 31 04:50:08.397918 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 336/694] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:08 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:09.047313 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:09.049351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:09.058312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:09.073354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:09.073354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:09.073354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:09.259246 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:09.268449 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:09.271121 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:09.272350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-eb9ac1fb-0cc7-447d-a5b1-4d4db0d8ca97 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.231694 Jan 31 04:50:09.286871 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 359/695] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:09 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:09.413985 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d48ea0e4-cf8e-4882-b8af-09eb0a8f8fe9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:09.414979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d48ea0e4-cf8e-4882-b8af-09eb0a8f8fe9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:09.421352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d48ea0e4-cf8e-4882-b8af-09eb0a8f8fe9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:09.421796 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d48ea0e4-cf8e-4882-b8af-09eb0a8f8fe9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:09.422616 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d48ea0e4-cf8e-4882-b8af-09eb0a8f8fe9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:09.423099 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d48ea0e4-cf8e-4882-b8af-09eb0a8f8fe9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:09.563486 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d48ea0e4-cf8e-4882-b8af-09eb0a8f8fe9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:09.571836 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d48ea0e4-cf8e-4882-b8af-09eb0a8f8fe9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.161421 Jan 31 04:50:09.572476 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 337/696] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:09 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:10.294184 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:10.294890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:10.301547 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:10.301992 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:10.302776 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:10.303230 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:10.453821 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:10.462631 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:10.464152 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:10.465295 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-035f9ba3-5604-40a8-9efb-a284355eddde tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.175061 Jan 31 04:50:10.465862 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 360/697] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:10 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:10.589611 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-25c39ecb-ec05-42b5-a3ed-6984abdc1dae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:10.590270 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-25c39ecb-ec05-42b5-a3ed-6984abdc1dae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:10.599076 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25c39ecb-ec05-42b5-a3ed-6984abdc1dae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:10.599516 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25c39ecb-ec05-42b5-a3ed-6984abdc1dae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:10.600280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25c39ecb-ec05-42b5-a3ed-6984abdc1dae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:10.600703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25c39ecb-ec05-42b5-a3ed-6984abdc1dae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:10.748276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-25c39ecb-ec05-42b5-a3ed-6984abdc1dae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:10.756380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-25c39ecb-ec05-42b5-a3ed-6984abdc1dae tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.171045 Jan 31 04:50:10.757032 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 338/698] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:10 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:11.486034 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:11.486668 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:11.493724 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:11.494878 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:11.502383 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:11.502383 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:11.651753 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:11.659878 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:11.661402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:11.662578 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5f754dd3-9189-4a9c-a59d-5976ee6df895 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.182291 Jan 31 04:50:11.663161 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 361/699] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:11 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:11.773381 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-643d3e77-1bb2-4ca9-8f58-0480523249d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:11.774687 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-643d3e77-1bb2-4ca9-8f58-0480523249d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:11.781830 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-643d3e77-1bb2-4ca9-8f58-0480523249d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:11.782341 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-643d3e77-1bb2-4ca9-8f58-0480523249d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:11.783231 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-643d3e77-1bb2-4ca9-8f58-0480523249d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:11.783731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-643d3e77-1bb2-4ca9-8f58-0480523249d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:11.934177 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-643d3e77-1bb2-4ca9-8f58-0480523249d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:11.942542 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-643d3e77-1bb2-4ca9-8f58-0480523249d0 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.172608 Jan 31 04:50:11.943139 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 339/700] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:11 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:12.681749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:12.682576 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:12.689675 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:12.690381 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:12.691908 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:12.692555 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:12.845676 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:12.854335 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:12.855913 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:12.857036 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-eecc4980-e13d-4bad-86a7-d3fee395d820 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1738 microversion: 2.20 time: 0.180052 Jan 31 04:50:12.857581 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 362/701] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:12 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:12.961662 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-27792471-e4e2-4bdc-9353-5c4534b23e91 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:12.962262 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-27792471-e4e2-4bdc-9353-5c4534b23e91 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:12.968690 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-27792471-e4e2-4bdc-9353-5c4534b23e91 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:12.969116 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-27792471-e4e2-4bdc-9353-5c4534b23e91 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:12.969897 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-27792471-e4e2-4bdc-9353-5c4534b23e91 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:12.970334 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-27792471-e4e2-4bdc-9353-5c4534b23e91 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:13.114882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-27792471-e4e2-4bdc-9353-5c4534b23e91 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:13.123042 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-27792471-e4e2-4bdc-9353-5c4534b23e91 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.167596 Jan 31 04:50:13.123607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 340/702] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:12 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:13.875717 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:13.877285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:13.885107 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:13.885827 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:13.886844 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:13.887859 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:14.139894 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e2b1d989-ad14-4f75-b487-34fde72da9f8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:14.142032 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:14.144617 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e2b1d989-ad14-4f75-b487-34fde72da9f8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:14.154318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:14.158008 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e2b1d989-ad14-4f75-b487-34fde72da9f8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:14.159988 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:14.162240 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e2b1d989-ad14-4f75-b487-34fde72da9f8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:14.164792 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e2b1d989-ad14-4f75-b487-34fde72da9f8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:14.166341 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ce2edc3c-7f59-437e-b745-566a90834b1f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1720 microversion: 2.20 time: 0.294177 Jan 31 04:50:14.167134 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e2b1d989-ad14-4f75-b487-34fde72da9f8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:14.170980 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 363/703] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:13 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1720 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:14.453919 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e2b1d989-ad14-4f75-b487-34fde72da9f8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:14.463230 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e2b1d989-ad14-4f75-b487-34fde72da9f8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.326694 Jan 31 04:50:14.463812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 341/704] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:14 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:15.189158 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:15.189760 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:15.196552 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:15.197037 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:15.197839 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:15.198269 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:15.338828 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:15.346549 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:15.348070 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:15.349219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-12299b41-1cb1-41a0-a01c-9204d8e2125b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1720 microversion: 2.20 time: 0.163815 Jan 31 04:50:15.349771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 364/705] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:15 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:15.480737 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9460dc2b-bff5-4e41-81d4-8a53a9e6478b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:15.481334 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9460dc2b-bff5-4e41-81d4-8a53a9e6478b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:15.488767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9460dc2b-bff5-4e41-81d4-8a53a9e6478b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:15.488767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9460dc2b-bff5-4e41-81d4-8a53a9e6478b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:15.489058 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9460dc2b-bff5-4e41-81d4-8a53a9e6478b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:15.489438 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9460dc2b-bff5-4e41-81d4-8a53a9e6478b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:15.696345 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9460dc2b-bff5-4e41-81d4-8a53a9e6478b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:15.704204 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9460dc2b-bff5-4e41-81d4-8a53a9e6478b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.227760 Jan 31 04:50:15.704789 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 342/706] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:15 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:16.368251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:16.368921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:16.375302 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:16.375744 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:16.376562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:16.377241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:16.520197 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:16.528148 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:16.529615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:16.533750 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-315d60f0-d593-481c-8868-712daf61662e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1720 microversion: 2.20 time: 0.166956 Jan 31 04:50:16.533750 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 365/707] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:16 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:16.721253 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-477d8304-2e06-4b47-bcbe-4b1dcf5ea595 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:16.722079 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-477d8304-2e06-4b47-bcbe-4b1dcf5ea595 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:16.729698 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-477d8304-2e06-4b47-bcbe-4b1dcf5ea595 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:16.735244 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-477d8304-2e06-4b47-bcbe-4b1dcf5ea595 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:16.735244 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-477d8304-2e06-4b47-bcbe-4b1dcf5ea595 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:16.735244 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-477d8304-2e06-4b47-bcbe-4b1dcf5ea595 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:16.878672 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-477d8304-2e06-4b47-bcbe-4b1dcf5ea595 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:16.886928 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-477d8304-2e06-4b47-bcbe-4b1dcf5ea595 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.169262 Jan 31 04:50:16.887493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 343/708] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:16 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:17.551486 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:17.552226 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:17.559238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:17.559923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:17.560986 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:17.561487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:17.662048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-b17f7591-b946-4121-89a1-c9678bc3d69d req-ebbbf83a-f7cb-4df6-9c03-a32d7bf4cbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde1517d-e13d-455c-a8dd-0119bb29148b", "name": "network-vif-unplugged", "status": "completed", "tag": "2eade66b-918f-4c8e-a64c-60d0ce7921a5"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:50:17.663858 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:50:17.663858 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:50:17.671469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-b17f7591-b946-4121-89a1-c9678bc3d69d req-ebbbf83a-f7cb-4df6-9c03-a32d7bf4cbf0 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:17.672105 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-b17f7591-b946-4121-89a1-c9678bc3d69d req-ebbbf83a-f7cb-4df6-9c03-a32d7bf4cbf0 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:17.687137 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.compute.server_external_events [req-b17f7591-b946-4121-89a1-c9678bc3d69d req-ebbbf83a-f7cb-4df6-9c03-a32d7bf4cbf0 service nova] Unable to find a host for instance dde1517d-e13d-455c-a8dd-0119bb29148b. Dropping event network-vif-unplugged {{(pid=123367) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 31 04:50:17.688482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-b17f7591-b946-4121-89a1-c9678bc3d69d req-ebbbf83a-f7cb-4df6-9c03-a32d7bf4cbf0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032420 Jan 31 04:50:17.689072 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 344/709] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 31 04:50:17.717207 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:17.729704 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:17.733951 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:17.733951 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8f89da8e-3369-44d6-bd84-fed747472caf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1663 microversion: 2.20 time: 0.186875 Jan 31 04:50:17.743754 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 366/710] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:17 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1663 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:17.752457 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3ff8eb0b-3bcb-45cb-a22c-ea5bf0c2a9df tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "978b12de-ba8f-4e5b-9100-f1f3561345cf"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:50:17.753525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3ff8eb0b-3bcb-45cb-a22c-ea5bf0c2a9df tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:17.760728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3ff8eb0b-3bcb-45cb-a22c-ea5bf0c2a9df tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:17.761177 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3ff8eb0b-3bcb-45cb-a22c-ea5bf0c2a9df tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:17.761944 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3ff8eb0b-3bcb-45cb-a22c-ea5bf0c2a9df tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:17.763245 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3ff8eb0b-3bcb-45cb-a22c-ea5bf0c2a9df tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:17.905157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ec8bbaaf-621e-4ea1-9c28-b6f38172423c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:17.905761 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ec8bbaaf-621e-4ea1-9c28-b6f38172423c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:17.911888 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec8bbaaf-621e-4ea1-9c28-b6f38172423c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:17.912368 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec8bbaaf-621e-4ea1-9c28-b6f38172423c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:17.913172 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec8bbaaf-621e-4ea1-9c28-b6f38172423c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:17.913572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec8bbaaf-621e-4ea1-9c28-b6f38172423c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:18.057183 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ec8bbaaf-621e-4ea1-9c28-b6f38172423c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:18.065004 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ec8bbaaf-621e-4ea1-9c28-b6f38172423c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.163434 Jan 31 04:50:18.065565 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 367/711] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:17 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:18.827931 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3ff8eb0b-3bcb-45cb-a22c-ea5bf0c2a9df tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.080560 Jan 31 04:50:18.828870 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 345/712] 10.222.0.21 () {62 vars in 1363 bytes} [Mon Jan 31 04:50:17 2022] POST /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments => generated 188 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 04:50:18.938228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-694c0736-135a-4788-a861-a2738ea1b8f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:50:18.938800 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-694c0736-135a-4788-a861-a2738ea1b8f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:18.945059 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-694c0736-135a-4788-a861-a2738ea1b8f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:18.945503 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-694c0736-135a-4788-a861-a2738ea1b8f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:18.947067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-694c0736-135a-4788-a861-a2738ea1b8f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:18.947516 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-694c0736-135a-4788-a861-a2738ea1b8f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:19.082138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2c338a71-dca6-42a2-ad5e-1b1abe37350f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:19.082742 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2c338a71-dca6-42a2-ad5e-1b1abe37350f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:19.089991 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2c338a71-dca6-42a2-ad5e-1b1abe37350f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:19.090645 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2c338a71-dca6-42a2-ad5e-1b1abe37350f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:19.097095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2c338a71-dca6-42a2-ad5e-1b1abe37350f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:19.097095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2c338a71-dca6-42a2-ad5e-1b1abe37350f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:19.197417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-694c0736-135a-4788-a861-a2738ea1b8f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/action" status: 202 len: 0 microversion: 2.20 time: 0.262668 Jan 31 04:50:19.200966 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 368/713] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Jan 31 04:50:18 2022] POST /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:50:19.209425 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:19.209425 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:19.222462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:19.222937 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:19.223730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:19.224166 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:19.236413 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2c338a71-dca6-42a2-ad5e-1b1abe37350f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:19.245133 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2c338a71-dca6-42a2-ad5e-1b1abe37350f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.166517 Jan 31 04:50:19.245702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 346/714] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:19 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:19.372021 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:19.381085 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:19.384926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:19.386279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-dacaf696-fce0-488b-8ba5-50e1f241ae44 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1749 microversion: 2.20 time: 0.183815 Jan 31 04:50:19.386867 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 369/715] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:19 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:20.261393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-23cf674f-42ed-46a0-a7d9-6f647690dd9a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:20.262140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-23cf674f-42ed-46a0-a7d9-6f647690dd9a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:20.268236 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-23cf674f-42ed-46a0-a7d9-6f647690dd9a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:20.268914 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-23cf674f-42ed-46a0-a7d9-6f647690dd9a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:20.269756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-23cf674f-42ed-46a0-a7d9-6f647690dd9a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:20.270380 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-23cf674f-42ed-46a0-a7d9-6f647690dd9a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:20.405733 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:20.406274 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-23cf674f-42ed-46a0-a7d9-6f647690dd9a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:20.406390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:20.415864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-23cf674f-42ed-46a0-a7d9-6f647690dd9a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.158299 Jan 31 04:50:20.416614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 347/716] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:20 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:20.421260 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:20.421707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:20.422491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:20.422941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:20.572874 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:20.580996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:20.582462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:20.583632 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7cac445d-5de8-4695-9ad1-ee8c370aba59 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1749 microversion: 2.20 time: 0.182575 Jan 31 04:50:20.584176 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 370/717] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:20 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1749 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:21.433715 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cb0f57bf-99c1-4bf7-9374-6d920a2251ee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:21.434366 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cb0f57bf-99c1-4bf7-9374-6d920a2251ee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:21.440398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cb0f57bf-99c1-4bf7-9374-6d920a2251ee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:21.440844 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cb0f57bf-99c1-4bf7-9374-6d920a2251ee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:21.441616 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cb0f57bf-99c1-4bf7-9374-6d920a2251ee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:21.442048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cb0f57bf-99c1-4bf7-9374-6d920a2251ee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:21.601819 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:21.602428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:21.610208 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:21.610861 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:21.611825 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:21.612417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:21.625554 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cb0f57bf-99c1-4bf7-9374-6d920a2251ee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:21.635604 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cb0f57bf-99c1-4bf7-9374-6d920a2251ee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.206127 Jan 31 04:50:21.636489 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 348/718] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:21 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:21.759326 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:21.767612 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:21.769126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:21.770244 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ecd2be70-0ec8-4a04-baa5-9c77c859701a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1751 microversion: 2.20 time: 0.172193 Jan 31 04:50:21.770809 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 371/719] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:21 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:22.653282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d3e9babd-04d0-4de7-8e68-5656b3ab0214 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:22.653886 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d3e9babd-04d0-4de7-8e68-5656b3ab0214 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:22.660003 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d3e9babd-04d0-4de7-8e68-5656b3ab0214 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:22.660443 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d3e9babd-04d0-4de7-8e68-5656b3ab0214 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:22.661208 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d3e9babd-04d0-4de7-8e68-5656b3ab0214 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:22.661640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d3e9babd-04d0-4de7-8e68-5656b3ab0214 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:22.791895 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:22.792665 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:22.795073 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d3e9babd-04d0-4de7-8e68-5656b3ab0214 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:22.798561 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:22.799028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:22.799806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:22.800235 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:22.803293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d3e9babd-04d0-4de7-8e68-5656b3ab0214 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.154515 Jan 31 04:50:22.803891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 349/720] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:22 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:22.949423 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:22.957909 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:22.959430 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:22.960657 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-dda7619e-c495-46fa-b171-28868b73f63b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1751 microversion: 2.20 time: 0.176800 Jan 31 04:50:22.961202 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 372/721] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:22 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:23.820300 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f3d5df27-2895-4dc8-bd14-95c45af43de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:23.820903 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f3d5df27-2895-4dc8-bd14-95c45af43de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:23.827596 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f3d5df27-2895-4dc8-bd14-95c45af43de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:23.831835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f3d5df27-2895-4dc8-bd14-95c45af43de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:23.831835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f3d5df27-2895-4dc8-bd14-95c45af43de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:23.831835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f3d5df27-2895-4dc8-bd14-95c45af43de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:23.979019 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:23.979763 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:23.985957 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:23.986401 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:23.987205 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:23.987639 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:24.111147 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f3d5df27-2895-4dc8-bd14-95c45af43de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:24.123978 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f3d5df27-2895-4dc8-bd14-95c45af43de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1725 microversion: 2.1 time: 0.307187 Jan 31 04:50:24.124709 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 350/722] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:23 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:24.307610 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:24.315881 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:24.317406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:24.318595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1b4fc6a6-48bf-4c4b-ad27-7b6aa45a3770 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1751 microversion: 2.20 time: 0.343915 Jan 31 04:50:24.319237 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 373/723] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:23 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1751 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:25.141623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8d5892af-aabc-403b-9d2c-c665d9bae9e2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:25.142361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8d5892af-aabc-403b-9d2c-c665d9bae9e2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:25.151087 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8d5892af-aabc-403b-9d2c-c665d9bae9e2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:25.151539 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8d5892af-aabc-403b-9d2c-c665d9bae9e2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:25.152324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8d5892af-aabc-403b-9d2c-c665d9bae9e2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:25.152909 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8d5892af-aabc-403b-9d2c-c665d9bae9e2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:25.312122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8d5892af-aabc-403b-9d2c-c665d9bae9e2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:25.320421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8d5892af-aabc-403b-9d2c-c665d9bae9e2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1702 microversion: 2.1 time: 0.182848 Jan 31 04:50:25.320985 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 351/724] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:25 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1702 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:25.336765 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:25.336964 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ae7d23e0-186d-45bc-b81f-0b536c1af10b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:50:25.338014 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:25.343768 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:25.343931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ae7d23e0-186d-45bc-b81f-0b536c1af10b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:25.344215 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:25.344339 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ae7d23e0-186d-45bc-b81f-0b536c1af10b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:25.344984 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:25.345726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:25.367273 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ae7d23e0-186d-45bc-b81f-0b536c1af10b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Going to try to start instance {{(pid=123368) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 31 04:50:25.485522 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:25.494589 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:25.496055 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:25.497215 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-69764496-3c58-4e08-b10b-1367a53dc290 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.163992 Jan 31 04:50:25.497776 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 352/725] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:25 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:25.533731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ae7d23e0-186d-45bc-b81f-0b536c1af10b tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/action" status: 202 len: 0 microversion: 2.1 time: 0.200218 Jan 31 04:50:25.534323 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 374/726] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:50:25 2022] POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:50:25.548715 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-de57f1ae-8957-471c-9927-9fbd9c3d619c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:25.549323 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-de57f1ae-8957-471c-9927-9fbd9c3d619c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:25.555345 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de57f1ae-8957-471c-9927-9fbd9c3d619c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:25.555792 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de57f1ae-8957-471c-9927-9fbd9c3d619c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:25.557681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de57f1ae-8957-471c-9927-9fbd9c3d619c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:25.558117 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-de57f1ae-8957-471c-9927-9fbd9c3d619c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:25.704703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-de57f1ae-8957-471c-9927-9fbd9c3d619c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:25.712925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-de57f1ae-8957-471c-9927-9fbd9c3d619c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1711 microversion: 2.1 time: 0.167653 Jan 31 04:50:25.713740 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 353/727] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:25 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1711 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:26.517220 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:26.517936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:26.523917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:26.524404 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:26.525339 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:26.525774 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:26.670377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:26.678908 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:26.681505 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:26.682312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a76230ef-11ac-4107-956d-95f8c73d99cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.170008 Jan 31 04:50:26.682886 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 375/728] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:26 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:26.730175 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bd17c358-b9e3-4e39-ba54-c2acf3f94145 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:26.730785 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bd17c358-b9e3-4e39-ba54-c2acf3f94145 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:26.737089 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd17c358-b9e3-4e39-ba54-c2acf3f94145 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:26.737606 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd17c358-b9e3-4e39-ba54-c2acf3f94145 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:26.738546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd17c358-b9e3-4e39-ba54-c2acf3f94145 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:26.739189 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd17c358-b9e3-4e39-ba54-c2acf3f94145 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:26.877050 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-bd17c358-b9e3-4e39-ba54-c2acf3f94145 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:26.885103 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bd17c358-b9e3-4e39-ba54-c2acf3f94145 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1711 microversion: 2.1 time: 0.158288 Jan 31 04:50:26.886241 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 354/729] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:26 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:27.703429 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:27.704046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:27.731747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:27.731747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:27.731747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:27.731747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:27.903670 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-fae30681-11fb-4254-9c48-4590d8fd08ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:27.904955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-fae30681-11fb-4254-9c48-4590d8fd08ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:27.917627 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fae30681-11fb-4254-9c48-4590d8fd08ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:27.918558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fae30681-11fb-4254-9c48-4590d8fd08ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:27.922617 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fae30681-11fb-4254-9c48-4590d8fd08ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:27.923150 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fae30681-11fb-4254-9c48-4590d8fd08ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:28.000745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:28.014951 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:28.017279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:28.019572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-23ae096f-53c6-4046-b0af-233b542b50a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.321130 Jan 31 04:50:28.020602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 376/730] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:27 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:28.173321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-fae30681-11fb-4254-9c48-4590d8fd08ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:28.183500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-fae30681-11fb-4254-9c48-4590d8fd08ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1715 microversion: 2.1 time: 0.284938 Jan 31 04:50:28.184288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 355/731] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:27 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1715 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:28.860378 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7c4f1b07-b744-45dc-b766-026e2adfa0d8 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "deb7524d-ce1d-4b40-ae03-45d638557021", "device": "/dev/sdb"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:50:28.866771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7c4f1b07-b744-45dc-b766-026e2adfa0d8 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:28.874082 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7c4f1b07-b744-45dc-b766-026e2adfa0d8 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:28.874528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7c4f1b07-b744-45dc-b766-026e2adfa0d8 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:28.875356 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7c4f1b07-b744-45dc-b766-026e2adfa0d8 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:28.875794 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7c4f1b07-b744-45dc-b766-026e2adfa0d8 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:29.038670 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:29.039415 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:29.046310 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:29.046748 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:29.047543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:29.047972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:29.290030 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:29.298396 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:29.300543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:29.301448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0396e935-dd0f-45be-95ee-0926e9b1c48a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.266289 Jan 31 04:50:29.310955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 356/732] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:29 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:30.319536 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:30.320909 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:30.328452 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:30.339821 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:30.339821 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:30.339821 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:30.505352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:30.515334 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:30.517459 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:30.517938 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-07c5ba90-38da-4e59-a427-612d69b14ce9 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.202210 Jan 31 04:50:30.518495 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 357/733] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:30 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:31.535575 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:31.536225 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:31.543270 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:31.544052 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:31.544992 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:31.545573 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:31.754594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:31.765162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:31.766827 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:31.768282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4e6ca320-93cb-4ccb-b0e2-9a486c7ad63e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.236270 Jan 31 04:50:31.779617 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 358/734] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:31 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:32.979265 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:32.980181 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:32.991222 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:32.992243 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:32.993031 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:32.993540 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:33.168413 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:33.176930 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:33.178475 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:33.179886 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9b087bd1-fbd3-482f-bb26-74dd87d73032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.396980 Jan 31 04:50:33.181504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 359/735] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:32 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:34.200024 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:34.200767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:34.206929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:34.207367 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:34.208128 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:34.208552 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:34.354842 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:34.366275 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:34.372303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:34.373490 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a03b299f-74f1-446b-bc67-ae2f559b3e9c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.177857 Jan 31 04:50:34.378838 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 360/736] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:34 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:35.392135 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:35.392802 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:35.400518 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:35.402301 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:35.403123 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:35.403719 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:35.594140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:35.602534 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:35.604292 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:35.605421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-dcf1e546-7557-4d2f-8859-c8a3e8360b7f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.216988 Jan 31 04:50:35.605979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 361/737] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:35 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:36.627330 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:36.628091 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:36.635251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:36.635621 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:36.636490 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:36.637065 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:36.771257 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:36.780107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:36.781589 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:36.782990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a939ead8-12f7-44fa-821d-d87ae432fd3c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.159842 Jan 31 04:50:36.783802 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 362/738] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:36 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:37.801572 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:37.802169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:37.808492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:37.808926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:37.809689 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:37.810115 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:37.945199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:37.955288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:37.956800 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:37.957975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-812c8deb-269b-408e-92bf-8e1209672dc1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.160003 Jan 31 04:50:37.958534 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 363/739] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:37 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:38.976193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:38.976806 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:38.983573 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:38.984012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:38.984773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:38.985200 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:39.128261 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:39.136498 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:39.137992 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:39.139159 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-24401578-acbc-423a-a8e0-e7c719724024 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.166605 Jan 31 04:50:39.139718 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 364/740] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:38 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:40.157527 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:40.158133 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:40.164503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:40.164962 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:40.165992 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:40.166983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:40.303411 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:40.313279 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:40.314751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:40.315919 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-66eb3187-843e-4ea9-bb47-3e798ac4ad0d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.162205 Jan 31 04:50:40.316466 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 365/741] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:40 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:50:41.334734 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:41.335464 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:41.343189 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:41.343556 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:41.344487 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:41.344919 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:41.487131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:41.496280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:41.497769 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:41.498952 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1a9af836-2a4c-4a53-9303-03a8437d4974 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.167843 Jan 31 04:50:41.499619 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 366/742] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:41 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:41.615286 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7c4f1b07-b744-45dc-b766-026e2adfa0d8 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "POST /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.758385 Jan 31 04:50:41.616388 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 377/743] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:50:28 2022] POST /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d/os-volume_attachments => generated 194 bytes in 12760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:50:42.517276 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:42.517874 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:42.524064 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:42.524511 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:42.525282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:42.525703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:42.579335 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1508932719", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:50:42.634687 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] validate_networks() for None {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:50:42.664124 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:42.672296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:42.673813 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:42.675038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a6a657fe-de1a-4813-beb6-bda08232d65e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.161415 Jan 31 04:50:42.675864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 367/744] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:42 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:42.927618 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:50:42.928077 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:50:42.928536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:50:42.928946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:50:42.929352 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:50:42.938765 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:42.939242 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:42.940043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:42.940471 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:42.956629 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Getting quotas for project cc3f8d5edc6a418a90a54972adb055ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:50:42.960947 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Getting quotas for user 92c9726c4c8a47b6a0ec38d41a54c889 and project cc3f8d5edc6a418a90a54972adb055ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:50:42.972126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:50:42.974489 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:50:43.092919 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7f8d5340-fa79-48da-b8bb-224942e4f9d1 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517265 Jan 31 04:50:43.093617 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 378/745] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:50:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 04:50:43.104417 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7c8efcef-2628-411d-b12f-ca093ba17a60 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:43.104860 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7c8efcef-2628-411d-b12f-ca093ba17a60 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:43.159324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7c8efcef-2628-411d-b12f-ca093ba17a60 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:43.169751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7c8efcef-2628-411d-b12f-ca093ba17a60 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1215 microversion: 2.1 time: 0.069864 Jan 31 04:50:43.170351 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 368/746] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:43 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:43.693816 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:43.694406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:43.701860 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:43.703738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:43.703738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:43.703738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:43.841865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:43.850052 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:43.851772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:43.853105 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b353e9ba-cfab-44a0-9757-739a81f8fb6e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.163480 Jan 31 04:50:43.853642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 379/747] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:43 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:44.186672 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-83c53b22-556b-4e9f-b958-e264924158f5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:44.187312 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-83c53b22-556b-4e9f-b958-e264924158f5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:44.194523 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-83c53b22-556b-4e9f-b958-e264924158f5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:44.194995 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-83c53b22-556b-4e9f-b958-e264924158f5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:44.195762 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-83c53b22-556b-4e9f-b958-e264924158f5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:44.196436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-83c53b22-556b-4e9f-b958-e264924158f5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:44.259692 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-83c53b22-556b-4e9f-b958-e264924158f5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:44.267746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-83c53b22-556b-4e9f-b958-e264924158f5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1219 microversion: 2.1 time: 0.084744 Jan 31 04:50:44.268303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 369/748] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:44 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:44.872149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:44.872748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:44.879360 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:44.879802 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:44.880559 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:44.880987 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:45.024848 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:45.033357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:45.034916 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:45.036163 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-eb9bfa0e-0b2c-4311-a348-820b651c6f10 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.168259 Jan 31 04:50:45.036747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 380/749] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:44 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:45.285141 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f500fe14-17ff-4128-8b94-7cc2bd2f48d6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:45.285800 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f500fe14-17ff-4128-8b94-7cc2bd2f48d6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:45.293046 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f500fe14-17ff-4128-8b94-7cc2bd2f48d6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:45.293782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f500fe14-17ff-4128-8b94-7cc2bd2f48d6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:45.294746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f500fe14-17ff-4128-8b94-7cc2bd2f48d6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:45.295398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f500fe14-17ff-4128-8b94-7cc2bd2f48d6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:45.361712 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f500fe14-17ff-4128-8b94-7cc2bd2f48d6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:45.370039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f500fe14-17ff-4128-8b94-7cc2bd2f48d6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1275 microversion: 2.1 time: 0.088149 Jan 31 04:50:45.371235 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 370/750] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:45 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:46.054995 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:46.055599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:46.063573 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:46.063998 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:46.064777 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:46.065403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:46.275189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:46.284323 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:46.285779 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:46.286945 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-467c454d-3120-4420-9870-a1ae3017aca3 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.235675 Jan 31 04:50:46.287500 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 381/751] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:46 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:46.388122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c1e22203-4374-43a1-9ad6-b3d5e9f8c421 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:46.388694 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c1e22203-4374-43a1-9ad6-b3d5e9f8c421 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:46.395006 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c1e22203-4374-43a1-9ad6-b3d5e9f8c421 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:46.395450 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c1e22203-4374-43a1-9ad6-b3d5e9f8c421 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:46.396226 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c1e22203-4374-43a1-9ad6-b3d5e9f8c421 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:46.396657 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c1e22203-4374-43a1-9ad6-b3d5e9f8c421 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:46.529383 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c1e22203-4374-43a1-9ad6-b3d5e9f8c421 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:46.536515 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c1e22203-4374-43a1-9ad6-b3d5e9f8c421 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.152771 Jan 31 04:50:46.537101 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 371/752] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:46 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:47.011352 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-22288a44-16c5-4724-adfe-659ff0200f29 req-92c71fe5-fb76-4fa4-9962-b888c541829f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dbda0e-de30-411e-be54-942c20451839", "tag": "c5d0b06e-7080-4338-a709-b6908a39614b"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:50:47.013332 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:50:47.013332 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:50:47.039422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-22288a44-16c5-4724-adfe-659ff0200f29 req-92c71fe5-fb76-4fa4-9962-b888c541829f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:47.040065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-22288a44-16c5-4724-adfe-659ff0200f29 req-92c71fe5-fb76-4fa4-9962-b888c541829f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:47.055390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-22288a44-16c5-4724-adfe-659ff0200f29 req-92c71fe5-fb76-4fa4-9962-b888c541829f service nova] Creating event network-changed:c5d0b06e-7080-4338-a709-b6908a39614b for instance 10dbda0e-de30-411e-be54-942c20451839 on hv-cinder-82660 Jan 31 04:50:47.060523 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-22288a44-16c5-4724-adfe-659ff0200f29 req-92c71fe5-fb76-4fa4-9962-b888c541829f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053195 Jan 31 04:50:47.064383 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 382/753] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:50:47.305298 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:47.305904 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:47.312002 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:47.312454 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:47.313421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:47.313863 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:47.450007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:47.458568 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:47.460102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:47.462917 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7dafea92-31a8-4344-be3d-1e05c6bd77cd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.159718 Jan 31 04:50:47.462917 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 372/754] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:47 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:47.553723 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-df47fef5-3e5e-4d61-8341-d90869459069 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:47.554513 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-df47fef5-3e5e-4d61-8341-d90869459069 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:47.561197 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-df47fef5-3e5e-4d61-8341-d90869459069 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:47.561646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-df47fef5-3e5e-4d61-8341-d90869459069 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:47.562429 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-df47fef5-3e5e-4d61-8341-d90869459069 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:47.562921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-df47fef5-3e5e-4d61-8341-d90869459069 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:47.792212 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-df47fef5-3e5e-4d61-8341-d90869459069 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:47.799861 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-df47fef5-3e5e-4d61-8341-d90869459069 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.250116 Jan 31 04:50:47.800526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 383/755] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:47 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:48.480415 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:48.481024 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:48.487287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:48.487760 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:48.488522 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:48.488954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:48.615068 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:48.623741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:48.625307 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:48.626717 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-74a25f88-e9e7-4436-aa1d-e8a421944d6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.150436 Jan 31 04:50:48.627293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 373/756] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:48 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:48.816482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3e7e4d94-0f6e-4522-b60a-638fce06a03b tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:48.817012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3e7e4d94-0f6e-4522-b60a-638fce06a03b tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:48.823829 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3e7e4d94-0f6e-4522-b60a-638fce06a03b tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:48.824272 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3e7e4d94-0f6e-4522-b60a-638fce06a03b tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:48.825039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3e7e4d94-0f6e-4522-b60a-638fce06a03b tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:48.825474 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3e7e4d94-0f6e-4522-b60a-638fce06a03b tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:48.953921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3e7e4d94-0f6e-4522-b60a-638fce06a03b tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:48.961110 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3e7e4d94-0f6e-4522-b60a-638fce06a03b tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.148308 Jan 31 04:50:48.961660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 384/757] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:48 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:49.643853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:49.644434 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:49.650508 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:49.651669 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:49.651836 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:49.652752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:49.783016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:49.791206 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:49.792740 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:49.793959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2079a5d5-1114-4789-8f80-e4ab413e62ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.153697 Jan 31 04:50:49.794515 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 374/758] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:49 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:49.978179 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-346c22c6-efe0-44f8-8527-d2f537de6425 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:49.978806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-346c22c6-efe0-44f8-8527-d2f537de6425 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:49.985061 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-346c22c6-efe0-44f8-8527-d2f537de6425 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:49.985538 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-346c22c6-efe0-44f8-8527-d2f537de6425 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:49.986310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-346c22c6-efe0-44f8-8527-d2f537de6425 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:49.986746 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-346c22c6-efe0-44f8-8527-d2f537de6425 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:50.119728 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-346c22c6-efe0-44f8-8527-d2f537de6425 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:50.128784 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-346c22c6-efe0-44f8-8527-d2f537de6425 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.154166 Jan 31 04:50:50.129351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 385/759] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:49 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:50.812036 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:50.812636 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:50.818737 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:50.819208 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:50.819991 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:50.820419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:51.145147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-79bfdefd-5a65-4a22-9be6-cbe1deb8f8a5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:51.146355 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-79bfdefd-5a65-4a22-9be6-cbe1deb8f8a5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:51.153390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-79bfdefd-5a65-4a22-9be6-cbe1deb8f8a5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:51.153840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-79bfdefd-5a65-4a22-9be6-cbe1deb8f8a5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:51.154651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-79bfdefd-5a65-4a22-9be6-cbe1deb8f8a5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:51.155117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-79bfdefd-5a65-4a22-9be6-cbe1deb8f8a5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:51.163422 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:51.171533 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:51.173002 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:51.174129 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-82bef75c-ab60-4dac-a7b1-098469663261 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.366002 Jan 31 04:50:51.174679 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 375/760] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:50 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:51.287251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-79bfdefd-5a65-4a22-9be6-cbe1deb8f8a5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:51.294280 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-79bfdefd-5a65-4a22-9be6-cbe1deb8f8a5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.152825 Jan 31 04:50:51.294845 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 386/761] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:51 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:52.192579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:52.193287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:52.199677 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:52.200124 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:52.200889 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:52.201318 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:52.311878 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-641445a6-9921-41cf-bc69-0531aaec98a3 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:52.312565 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-641445a6-9921-41cf-bc69-0531aaec98a3 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:52.318748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-641445a6-9921-41cf-bc69-0531aaec98a3 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:52.319358 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-641445a6-9921-41cf-bc69-0531aaec98a3 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:52.320364 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-641445a6-9921-41cf-bc69-0531aaec98a3 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:52.320873 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-641445a6-9921-41cf-bc69-0531aaec98a3 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:52.333352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:52.341805 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:52.343456 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:52.344606 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a90e44ae-cd6c-4f19-bc58-830261066b3d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.155740 Jan 31 04:50:52.345225 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 376/762] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:52 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:52.450142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-641445a6-9921-41cf-bc69-0531aaec98a3 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:52.457182 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-641445a6-9921-41cf-bc69-0531aaec98a3 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.150593 Jan 31 04:50:52.457744 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 387/763] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:52 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:50:53.361453 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:53.362052 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:53.373782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:53.374222 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:53.375029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:53.375458 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:53.473234 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-740c7278-548c-43ca-966d-0927fe1bbcb5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:53.473836 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-740c7278-548c-43ca-966d-0927fe1bbcb5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:53.480050 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-740c7278-548c-43ca-966d-0927fe1bbcb5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:53.480488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-740c7278-548c-43ca-966d-0927fe1bbcb5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:53.481256 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-740c7278-548c-43ca-966d-0927fe1bbcb5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:53.481685 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-740c7278-548c-43ca-966d-0927fe1bbcb5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:53.508803 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:53.517825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:53.519326 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:53.520462 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-10184a75-4d01-415c-b860-6f229d615d93 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.162626 Jan 31 04:50:53.521015 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 377/764] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:53 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:53.615685 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-740c7278-548c-43ca-966d-0927fe1bbcb5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:53.623611 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-740c7278-548c-43ca-966d-0927fe1bbcb5 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.154011 Jan 31 04:50:53.624162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 388/765] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:53 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:54.538773 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:54.539394 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:54.546120 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:54.546555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:54.547340 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:54.547769 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:54.640061 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9164400b-50e5-4963-bfb1-88e452a96b03 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:54.640695 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9164400b-50e5-4963-bfb1-88e452a96b03 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:54.647074 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9164400b-50e5-4963-bfb1-88e452a96b03 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:54.647524 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9164400b-50e5-4963-bfb1-88e452a96b03 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:54.648306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9164400b-50e5-4963-bfb1-88e452a96b03 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:54.648745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9164400b-50e5-4963-bfb1-88e452a96b03 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:54.678721 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:54.687806 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:54.689308 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:54.690459 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2a60c51a-4447-4c2f-81f3-0d665ea49feb tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.155299 Jan 31 04:50:54.691069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 378/766] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:54 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:54.778291 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9164400b-50e5-4963-bfb1-88e452a96b03 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:54.785432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9164400b-50e5-4963-bfb1-88e452a96b03 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.149685 Jan 31 04:50:54.786007 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 389/767] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:54 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:55.708882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:55.709480 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:55.715792 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:55.716229 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:55.716986 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:55.717410 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:55.802493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-29299439-b1fa-4f3b-bf21-56d8878ecdcc tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:55.803117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-29299439-b1fa-4f3b-bf21-56d8878ecdcc tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:55.809310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-29299439-b1fa-4f3b-bf21-56d8878ecdcc tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:55.809754 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-29299439-b1fa-4f3b-bf21-56d8878ecdcc tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:55.810521 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-29299439-b1fa-4f3b-bf21-56d8878ecdcc tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:55.811081 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-29299439-b1fa-4f3b-bf21-56d8878ecdcc tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:55.853792 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:55.862807 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:55.864303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:55.865434 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a36df5e4-4b2f-43d7-9365-91c08a4a5eea tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.160176 Jan 31 04:50:55.865987 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 379/768] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:55 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:55.939764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-29299439-b1fa-4f3b-bf21-56d8878ecdcc tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:55.946764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-29299439-b1fa-4f3b-bf21-56d8878ecdcc tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.147838 Jan 31 04:50:55.947343 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 390/769] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:55 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:56.883332 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:56.883882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:56.890686 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:56.891152 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:56.891906 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:56.892330 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:56.962870 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-858a637f-15a6-44c8-ba1e-351a83f81980 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:56.963479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-858a637f-15a6-44c8-ba1e-351a83f81980 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:56.969535 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-858a637f-15a6-44c8-ba1e-351a83f81980 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:56.969982 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-858a637f-15a6-44c8-ba1e-351a83f81980 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:56.970756 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-858a637f-15a6-44c8-ba1e-351a83f81980 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:56.971300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-858a637f-15a6-44c8-ba1e-351a83f81980 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:57.021292 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:57.029650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:57.031147 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:57.032293 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c03f6ac5-2c47-4038-88f1-625cae388824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.152705 Jan 31 04:50:57.032850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 380/770] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:56 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:57.105690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-858a637f-15a6-44c8-ba1e-351a83f81980 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:57.112944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-858a637f-15a6-44c8-ba1e-351a83f81980 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.153742 Jan 31 04:50:57.113503 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 391/771] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:56 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:58.050379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:58.051011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:58.057483 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:58.057920 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:58.059236 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:58.059666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:58.130501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f6d12fa7-c90a-4835-b169-b6aa961ba55f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:58.131147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f6d12fa7-c90a-4835-b169-b6aa961ba55f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:58.138093 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f6d12fa7-c90a-4835-b169-b6aa961ba55f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:58.138538 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f6d12fa7-c90a-4835-b169-b6aa961ba55f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:58.139343 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f6d12fa7-c90a-4835-b169-b6aa961ba55f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:58.139783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f6d12fa7-c90a-4835-b169-b6aa961ba55f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:58.190629 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:58.198949 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:58.200993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:58.202150 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0746aa53-f893-4837-ac67-fd08e4d98eb1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.155406 Jan 31 04:50:58.202708 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 381/772] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:58 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:58.272051 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f6d12fa7-c90a-4835-b169-b6aa961ba55f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:58.281948 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f6d12fa7-c90a-4835-b169-b6aa961ba55f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.155335 Jan 31 04:50:58.282524 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 392/773] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:58 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:50:59.220401 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:59.221011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:59.227443 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:59.227950 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:59.228754 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:59.229160 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:59.298293 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-920883dd-313a-47d3-bfea-189ec044970d tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:50:59.298926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-920883dd-313a-47d3-bfea-189ec044970d tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:50:59.305173 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-920883dd-313a-47d3-bfea-189ec044970d tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:59.305623 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-920883dd-313a-47d3-bfea-189ec044970d tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:59.306404 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-920883dd-313a-47d3-bfea-189ec044970d tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:50:59.306866 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-920883dd-313a-47d3-bfea-189ec044970d tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:50:59.364406 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:59.372737 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:59.374316 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:59.375509 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-86842623-1f5d-4cd6-8adf-d9b5e2e76aa5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.158841 Jan 31 04:50:59.379398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 382/774] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:50:59 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:50:59.441488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-920883dd-313a-47d3-bfea-189ec044970d tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:50:59.449454 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-920883dd-313a-47d3-bfea-189ec044970d tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.154437 Jan 31 04:50:59.450014 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 393/775] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:50:59 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:00.393358 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:00.393915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:00.400120 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:00.400560 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:00.401342 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:00.401768 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:00.466401 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-070dfc11-d4f6-45eb-9462-2d06f205dfe6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:00.467037 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-070dfc11-d4f6-45eb-9462-2d06f205dfe6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:00.473259 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-070dfc11-d4f6-45eb-9462-2d06f205dfe6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:00.473713 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-070dfc11-d4f6-45eb-9462-2d06f205dfe6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:00.474491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-070dfc11-d4f6-45eb-9462-2d06f205dfe6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:00.474957 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-070dfc11-d4f6-45eb-9462-2d06f205dfe6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:00.533613 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:00.541731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:00.543899 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:00.545007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-31e0df4b-ce69-4f96-8825-da8e86047881 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.155413 Jan 31 04:51:00.545565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 383/776] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:00 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:00.604103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-070dfc11-d4f6-45eb-9462-2d06f205dfe6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:00.611900 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-070dfc11-d4f6-45eb-9462-2d06f205dfe6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.149703 Jan 31 04:51:00.612459 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 394/777] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:00 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:01.562964 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:01.563563 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:01.569916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:01.570352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:01.571132 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:01.571559 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:01.628437 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-799e4992-881a-4773-a568-a79e15ff3f42 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:01.629045 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-799e4992-881a-4773-a568-a79e15ff3f42 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:01.635300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-799e4992-881a-4773-a568-a79e15ff3f42 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:01.635745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-799e4992-881a-4773-a568-a79e15ff3f42 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:01.637405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-799e4992-881a-4773-a568-a79e15ff3f42 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:01.638086 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-799e4992-881a-4773-a568-a79e15ff3f42 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:01.706440 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:01.716573 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:01.718176 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:01.719362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4be22ae3-7b92-4fed-8397-71b4c2879e0e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.160079 Jan 31 04:51:01.719942 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 384/778] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:01 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:01.772356 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-799e4992-881a-4773-a568-a79e15ff3f42 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:01.780022 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-799e4992-881a-4773-a568-a79e15ff3f42 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.155448 Jan 31 04:51:01.780583 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 395/779] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:01 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:02.737123 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:02.737717 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:02.743993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:02.744665 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:02.745174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:02.745600 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:02.797171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6c9b2e46-f02f-44f0-9992-31f3e8463880 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:02.797778 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6c9b2e46-f02f-44f0-9992-31f3e8463880 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:02.803907 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c9b2e46-f02f-44f0-9992-31f3e8463880 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:02.804345 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c9b2e46-f02f-44f0-9992-31f3e8463880 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:02.805119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c9b2e46-f02f-44f0-9992-31f3e8463880 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:02.805544 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c9b2e46-f02f-44f0-9992-31f3e8463880 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:02.876466 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:02.884487 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:02.885947 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:02.887683 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b9979896-8dec-4315-af7d-f05af9e7cf9d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.154177 Jan 31 04:51:02.888239 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 385/780] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:02 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:02.932938 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6c9b2e46-f02f-44f0-9992-31f3e8463880 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:02.941263 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6c9b2e46-f02f-44f0-9992-31f3e8463880 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.148344 Jan 31 04:51:02.941819 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 396/781] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:02 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:03.905484 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:03.906112 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:03.912272 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:03.912716 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:03.913476 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:03.913908 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:03.956997 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7455d145-bc91-4cba-a43c-557bb3ecf2ce tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:03.957633 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7455d145-bc91-4cba-a43c-557bb3ecf2ce tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:03.963789 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7455d145-bc91-4cba-a43c-557bb3ecf2ce tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:03.964243 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7455d145-bc91-4cba-a43c-557bb3ecf2ce tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:03.965885 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7455d145-bc91-4cba-a43c-557bb3ecf2ce tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:03.966325 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7455d145-bc91-4cba-a43c-557bb3ecf2ce tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:04.050376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:04.058554 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:04.060069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:04.061214 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c9032ff7-f2c9-4b8c-9330-971ac56e87ac tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.159784 Jan 31 04:51:04.061772 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 386/782] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:03 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:04.099579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7455d145-bc91-4cba-a43c-557bb3ecf2ce tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:04.107192 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7455d145-bc91-4cba-a43c-557bb3ecf2ce tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.153709 Jan 31 04:51:04.107747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 397/783] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:03 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:05.079220 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:05.079819 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:05.087529 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:05.087529 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:05.087529 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:05.087850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:05.123459 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-bab3cc9b-4e01-4cdc-9777-540448ee3642 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:05.124077 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-bab3cc9b-4e01-4cdc-9777-540448ee3642 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:05.130641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bab3cc9b-4e01-4cdc-9777-540448ee3642 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:05.131117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bab3cc9b-4e01-4cdc-9777-540448ee3642 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:05.131921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bab3cc9b-4e01-4cdc-9777-540448ee3642 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:05.132417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bab3cc9b-4e01-4cdc-9777-540448ee3642 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:05.228168 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:05.237964 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:05.239728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:05.241181 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3630cd06-dd12-4ac8-9845-115e596ada00 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.166015 Jan 31 04:51:05.242343 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 387/784] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:05 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:05.275787 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-bab3cc9b-4e01-4cdc-9777-540448ee3642 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:05.283629 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-bab3cc9b-4e01-4cdc-9777-540448ee3642 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.163981 Jan 31 04:51:05.284187 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 398/785] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:05 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:05.604131 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-8ebc4057-c57a-4e93-b86d-eeee4649661a req-0df6ff40-5c04-4199-907c-d50f1d39881d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde1517d-e13d-455c-a8dd-0119bb29148b", "name": "network-vif-plugged", "status": "completed", "tag": "2eade66b-918f-4c8e-a64c-60d0ce7921a5"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:51:05.605739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:51:05.605739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:51:05.612671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-8ebc4057-c57a-4e93-b86d-eeee4649661a req-0df6ff40-5c04-4199-907c-d50f1d39881d service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:05.613114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-8ebc4057-c57a-4e93-b86d-eeee4649661a req-0df6ff40-5c04-4199-907c-d50f1d39881d service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:05.624056 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-8ebc4057-c57a-4e93-b86d-eeee4649661a req-0df6ff40-5c04-4199-907c-d50f1d39881d service nova] Creating event network-vif-plugged:2eade66b-918f-4c8e-a64c-60d0ce7921a5 for instance dde1517d-e13d-455c-a8dd-0119bb29148b on hv-cinder-82660 Jan 31 04:51:05.629363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-8ebc4057-c57a-4e93-b86d-eeee4649661a req-0df6ff40-5c04-4199-907c-d50f1d39881d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028940 Jan 31 04:51:05.629931 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 388/786] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:51:06.259571 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:06.260071 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:06.266948 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:06.267393 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:06.268161 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:06.268593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:06.301039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-19d384cf-b4dd-4150-8e3e-287e926fd30f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:06.301749 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-19d384cf-b4dd-4150-8e3e-287e926fd30f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:06.309793 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-19d384cf-b4dd-4150-8e3e-287e926fd30f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:06.309793 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-19d384cf-b4dd-4150-8e3e-287e926fd30f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:06.309793 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-19d384cf-b4dd-4150-8e3e-287e926fd30f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:06.310295 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-19d384cf-b4dd-4150-8e3e-287e926fd30f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:06.400853 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:06.409050 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:06.410569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:06.411786 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-755227ee-04a2-43dc-804d-e3acbe8ae3e1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.155964 Jan 31 04:51:06.412460 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 399/787] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:06 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:06.449538 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-19d384cf-b4dd-4150-8e3e-287e926fd30f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:06.457284 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-19d384cf-b4dd-4150-8e3e-287e926fd30f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.160676 Jan 31 04:51:06.457837 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 389/788] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:06 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:07.429134 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:07.429768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:07.436144 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:07.436594 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:07.437360 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:07.437791 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:07.473209 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e0efc64d-6847-4465-b30b-74ada9ec045c tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:07.473912 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e0efc64d-6847-4465-b30b-74ada9ec045c tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:07.480130 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e0efc64d-6847-4465-b30b-74ada9ec045c tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:07.480572 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e0efc64d-6847-4465-b30b-74ada9ec045c tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:07.481364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e0efc64d-6847-4465-b30b-74ada9ec045c tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:07.481787 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e0efc64d-6847-4465-b30b-74ada9ec045c tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:07.571061 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:07.580222 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:07.581691 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:07.583075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5e722ef3-07ef-4e78-8b00-c155c2649e6c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.157651 Jan 31 04:51:07.584006 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 400/789] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:07 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:07.627174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e0efc64d-6847-4465-b30b-74ada9ec045c tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:07.634217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e0efc64d-6847-4465-b30b-74ada9ec045c tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.164566 Jan 31 04:51:07.634770 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 390/790] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:07 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:07.643426 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-eb90798c-d01b-47b1-9376-fe05233e8ea1 req-26b049da-eabe-48c6-94c6-5cdfd030681a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dbda0e-de30-411e-be54-942c20451839", "name": "network-vif-plugged", "status": "completed", "tag": "c5d0b06e-7080-4338-a709-b6908a39614b"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:51:07.645141 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:51:07.645141 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:51:07.651878 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-eb90798c-d01b-47b1-9376-fe05233e8ea1 req-26b049da-eabe-48c6-94c6-5cdfd030681a service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:07.652319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-eb90798c-d01b-47b1-9376-fe05233e8ea1 req-26b049da-eabe-48c6-94c6-5cdfd030681a service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:07.663382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-eb90798c-d01b-47b1-9376-fe05233e8ea1 req-26b049da-eabe-48c6-94c6-5cdfd030681a service nova] Creating event network-vif-plugged:c5d0b06e-7080-4338-a709-b6908a39614b for instance 10dbda0e-de30-411e-be54-942c20451839 on hv-cinder-82660 Jan 31 04:51:07.668141 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-eb90798c-d01b-47b1-9376-fe05233e8ea1 req-26b049da-eabe-48c6-94c6-5cdfd030681a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028324 Jan 31 04:51:07.668791 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 401/791] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:51:08.603948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:08.604552 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:08.610986 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:08.611431 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:08.612200 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:08.612627 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:08.652789 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-791d8020-3678-4b77-945a-55dfb3982048 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:08.653560 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-791d8020-3678-4b77-945a-55dfb3982048 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:08.659576 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-791d8020-3678-4b77-945a-55dfb3982048 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:08.660026 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-791d8020-3678-4b77-945a-55dfb3982048 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:08.660808 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-791d8020-3678-4b77-945a-55dfb3982048 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:08.661241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-791d8020-3678-4b77-945a-55dfb3982048 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:08.745218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:08.754526 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:08.756075 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:08.757225 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ee78b3f0-90a3-4263-be3a-8906aa466f29 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.156919 Jan 31 04:51:08.757778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 391/792] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:08 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:08.796044 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-791d8020-3678-4b77-945a-55dfb3982048 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:08.803210 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-791d8020-3678-4b77-945a-55dfb3982048 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.154941 Jan 31 04:51:08.803763 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 402/793] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:08 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:09.776040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:09.776644 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:09.782932 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:09.783379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:09.784146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:09.784581 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:09.819640 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3701db43-054c-4492-8a9a-22d0c59574c8 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:09.820274 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3701db43-054c-4492-8a9a-22d0c59574c8 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:09.827349 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3701db43-054c-4492-8a9a-22d0c59574c8 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:09.827829 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3701db43-054c-4492-8a9a-22d0c59574c8 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:09.828599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3701db43-054c-4492-8a9a-22d0c59574c8 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:09.829023 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3701db43-054c-4492-8a9a-22d0c59574c8 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:09.927749 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:09.937945 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:09.939457 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:09.940719 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3cb2830b-49dc-4d4e-b662-f09ee1b7d13f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.168309 Jan 31 04:51:09.941272 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 392/794] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:09 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:09.964936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3701db43-054c-4492-8a9a-22d0c59574c8 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:09.972760 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3701db43-054c-4492-8a9a-22d0c59574c8 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.156638 Jan 31 04:51:09.973552 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 403/795] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:09 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:10.957607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:10.958198 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:10.964372 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:10.964811 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:10.967102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:10.967102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:10.989672 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e0f425e0-7cd4-4d61-b464-0dc3c2e2d917 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:10.990387 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e0f425e0-7cd4-4d61-b464-0dc3c2e2d917 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:10.997826 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e0f425e0-7cd4-4d61-b464-0dc3c2e2d917 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:10.998274 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e0f425e0-7cd4-4d61-b464-0dc3c2e2d917 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:10.999078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e0f425e0-7cd4-4d61-b464-0dc3c2e2d917 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:10.999511 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e0f425e0-7cd4-4d61-b464-0dc3c2e2d917 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:11.132505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:11.143092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:11.143882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:11.145517 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e0f425e0-7cd4-4d61-b464-0dc3c2e2d917 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:11.145699 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b04f5e9e-f1cf-4f22-919c-4ec9ce4b1a85 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.191539 Jan 31 04:51:11.146688 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 393/796] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:10 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:51:11.154371 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e0f425e0-7cd4-4d61-b464-0dc3c2e2d917 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.168065 Jan 31 04:51:11.155136 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 404/797] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:10 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:12.165541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:12.165541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:12.170615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4fcc9d2c-d9f7-419b-ad6c-86963e8ec385 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:12.171291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:12.171435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4fcc9d2c-d9f7-419b-ad6c-86963e8ec385 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:12.171735 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:12.172509 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:12.173575 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:12.177913 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4fcc9d2c-d9f7-419b-ad6c-86963e8ec385 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:12.178356 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4fcc9d2c-d9f7-419b-ad6c-86963e8ec385 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:12.179179 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4fcc9d2c-d9f7-419b-ad6c-86963e8ec385 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:12.179605 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4fcc9d2c-d9f7-419b-ad6c-86963e8ec385 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:12.324633 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:12.334562 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:12.336544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:12.337447 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f29d50b8-49fe-4bf9-8ee9-1cfab7f328d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.176668 Jan 31 04:51:12.346826 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 394/798] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:12 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:12.558474 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4fcc9d2c-d9f7-419b-ad6c-86963e8ec385 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:12.565972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4fcc9d2c-d9f7-419b-ad6c-86963e8ec385 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1315 microversion: 2.1 time: 0.399327 Jan 31 04:51:12.566530 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 405/799] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:12 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:13.357739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:13.358369 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:13.364880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:13.367947 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:13.367947 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:13.367947 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:13.507244 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:13.515712 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:13.517262 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:13.518420 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ba68565c-2893-4752-bd0f-76860a9f22c4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1807 microversion: 2.20 time: 0.165185 Jan 31 04:51:13.519155 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 395/800] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:13 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:13.583267 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-942f473b-e3cb-4f37-a74a-19aaebf4d6c2 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:13.583869 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-942f473b-e3cb-4f37-a74a-19aaebf4d6c2 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:13.589988 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-942f473b-e3cb-4f37-a74a-19aaebf4d6c2 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:13.590427 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-942f473b-e3cb-4f37-a74a-19aaebf4d6c2 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:13.591221 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-942f473b-e3cb-4f37-a74a-19aaebf4d6c2 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:13.591732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-942f473b-e3cb-4f37-a74a-19aaebf4d6c2 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:13.726332 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-942f473b-e3cb-4f37-a74a-19aaebf4d6c2 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:13.734395 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-942f473b-e3cb-4f37-a74a-19aaebf4d6c2 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1465 microversion: 2.1 time: 0.155051 Jan 31 04:51:13.734987 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 406/801] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:13 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:13.771472 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-52851321-916b-4765-b201-a5a961e6bcd0 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:13.771966 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-52851321-916b-4765-b201-a5a961e6bcd0 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:13.778323 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-52851321-916b-4765-b201-a5a961e6bcd0 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:13.778809 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-52851321-916b-4765-b201-a5a961e6bcd0 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:13.779876 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-52851321-916b-4765-b201-a5a961e6bcd0 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:13.780361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-52851321-916b-4765-b201-a5a961e6bcd0 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:13.805461 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-52851321-916b-4765-b201-a5a961e6bcd0 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:51:14.090818 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-52851321-916b-4765-b201-a5a961e6bcd0 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "DELETE /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 204 len: 0 microversion: 2.1 time: 0.322094 Jan 31 04:51:14.091869 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 396/802] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:51:13 2022] DELETE /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:51:14.100210 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-07a59758-5462-4f4e-af53-bc2c09a2df8f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:14.100859 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-07a59758-5462-4f4e-af53-bc2c09a2df8f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:14.107812 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-07a59758-5462-4f4e-af53-bc2c09a2df8f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:14.108262 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-07a59758-5462-4f4e-af53-bc2c09a2df8f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:14.109039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-07a59758-5462-4f4e-af53-bc2c09a2df8f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:14.109473 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-07a59758-5462-4f4e-af53-bc2c09a2df8f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:14.258747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-07a59758-5462-4f4e-af53-bc2c09a2df8f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:14.266804 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-07a59758-5462-4f4e-af53-bc2c09a2df8f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1471 microversion: 2.1 time: 0.170587 Jan 31 04:51:14.267370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 407/803] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:14 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:14.536976 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:14.537853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:14.547428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:14.547428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:14.547428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:14.547428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:14.683571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:14.692997 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:14.694504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:14.695678 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ef3f9656-9d52-43a3-81bf-2d39e907461d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1794 microversion: 2.20 time: 0.163055 Jan 31 04:51:14.696226 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 397/804] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:51:14 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:51:15.181829 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-bbb48659-e942-4487-a251-f0fea803aaee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:15.182372 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-bbb48659-e942-4487-a251-f0fea803aaee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:15.189030 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bbb48659-e942-4487-a251-f0fea803aaee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:15.189479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bbb48659-e942-4487-a251-f0fea803aaee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:15.190312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bbb48659-e942-4487-a251-f0fea803aaee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:15.190748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bbb48659-e942-4487-a251-f0fea803aaee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:15.278049 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-bbb48659-e942-4487-a251-f0fea803aaee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lazy-loading 'services' on Instance uuid eb76b92c-8a69-4296-ac1a-e92639dfc36d {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:51:15.284699 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b3af6f7e-c307-4f47-8b88-ec10ead9cc31 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:15.285306 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b3af6f7e-c307-4f47-8b88-ec10ead9cc31 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:15.291926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3af6f7e-c307-4f47-8b88-ec10ead9cc31 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:15.292370 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3af6f7e-c307-4f47-8b88-ec10ead9cc31 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:15.293685 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3af6f7e-c307-4f47-8b88-ec10ead9cc31 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:15.294632 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3af6f7e-c307-4f47-8b88-ec10ead9cc31 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:15.432842 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b3af6f7e-c307-4f47-8b88-ec10ead9cc31 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:15.440000 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b3af6f7e-c307-4f47-8b88-ec10ead9cc31 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1471 microversion: 2.1 time: 0.158803 Jan 31 04:51:15.443764 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 398/805] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:15 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:15.478137 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-bbb48659-e942-4487-a251-f0fea803aaee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "DELETE /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d/os-volume_attachments/deb7524d-ce1d-4b40-ae03-45d638557021" status: 202 len: 0 microversion: 2.1 time: 0.299819 Jan 31 04:51:15.479135 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 408/806] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:51:15 2022] DELETE /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d/os-volume_attachments/deb7524d-ce1d-4b40-ae03-45d638557021 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:51:16.457026 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4494a813-ed36-4f53-862a-f6d18e2e92e6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:16.457634 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4494a813-ed36-4f53-862a-f6d18e2e92e6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:16.470231 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4494a813-ed36-4f53-862a-f6d18e2e92e6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:16.470683 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4494a813-ed36-4f53-862a-f6d18e2e92e6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:16.472666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4494a813-ed36-4f53-862a-f6d18e2e92e6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:16.472666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4494a813-ed36-4f53-862a-f6d18e2e92e6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:16.561270 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4494a813-ed36-4f53-862a-f6d18e2e92e6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9726c4c8a47b6a0ec38d41a54c889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3f8d5edc6a418a90a54972adb055ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:16.569259 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4494a813-ed36-4f53-862a-f6d18e2e92e6 tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 200 len: 1429 microversion: 2.1 time: 0.115601 Jan 31 04:51:16.569940 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 399/807] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:16 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:16.664538 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-65ea914d-9c98-454f-849a-17e83f4673d9 req-66cdaa38-206f-4910-8910-1c31d26606be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dbda0e-de30-411e-be54-942c20451839", "name": "network-vif-deleted", "tag": "c5d0b06e-7080-4338-a709-b6908a39614b"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:51:16.666165 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:51:16.666165 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:51:16.674109 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-65ea914d-9c98-454f-849a-17e83f4673d9 req-66cdaa38-206f-4910-8910-1c31d26606be service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:16.674548 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-65ea914d-9c98-454f-849a-17e83f4673d9 req-66cdaa38-206f-4910-8910-1c31d26606be service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:16.685336 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-65ea914d-9c98-454f-849a-17e83f4673d9 req-66cdaa38-206f-4910-8910-1c31d26606be service nova] Creating event network-vif-deleted:c5d0b06e-7080-4338-a709-b6908a39614b for instance 10dbda0e-de30-411e-be54-942c20451839 on hv-cinder-82660 Jan 31 04:51:16.689940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-65ea914d-9c98-454f-849a-17e83f4673d9 req-66cdaa38-206f-4910-8910-1c31d26606be service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194970 Jan 31 04:51:16.690525 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 409/808] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:51:17.591218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:17.591907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] [instance: 10dbda0e-de30-411e-be54-942c20451839] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:17.597874 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:17.598314 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:17.599271 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:17.599706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:17.612687 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] HTTP exception thrown: Instance 10dbda0e-de30-411e-be54-942c20451839 could not be found. Jan 31 04:51:17.613265 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] Returning 404 to user: Instance 10dbda0e-de30-411e-be54-942c20451839 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:51:17.614071 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-326f6d6f-b73b-44b7-a671-27232689530f tempest-VolumesNegativeTest-140881657 tempest-VolumesNegativeTest-140881657-project] 10.222.0.21 "GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839" status: 404 len: 111 microversion: 2.1 time: 0.026602 Jan 31 04:51:17.616535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 400/809] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:17 2022] GET /compute/v2.1/servers/10dbda0e-de30-411e-be54-942c20451839 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:51:17.692555 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4c32cc66-d016-4739-b85d-8d04e73256a7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:17.693305 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4c32cc66-d016-4739-b85d-8d04e73256a7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:17.700201 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4c32cc66-d016-4739-b85d-8d04e73256a7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:17.709402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4c32cc66-d016-4739-b85d-8d04e73256a7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:17.709402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4c32cc66-d016-4739-b85d-8d04e73256a7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:17.709402 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4c32cc66-d016-4739-b85d-8d04e73256a7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:17.728284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4c32cc66-d016-4739-b85d-8d04e73256a7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:51:18.004023 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4c32cc66-d016-4739-b85d-8d04e73256a7 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "DELETE /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 204 len: 0 microversion: 2.1 time: 0.315763 Jan 31 04:51:18.004914 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 410/810] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:51:17 2022] DELETE /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:51:18.013835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5120a6e1-d01c-431b-9ea1-96e9e40825cb tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:18.014445 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5120a6e1-d01c-431b-9ea1-96e9e40825cb tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:18.023599 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5120a6e1-d01c-431b-9ea1-96e9e40825cb tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:18.024047 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5120a6e1-d01c-431b-9ea1-96e9e40825cb tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:18.024885 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5120a6e1-d01c-431b-9ea1-96e9e40825cb tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:18.025382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5120a6e1-d01c-431b-9ea1-96e9e40825cb tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:18.160119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5120a6e1-d01c-431b-9ea1-96e9e40825cb tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:18.167581 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5120a6e1-d01c-431b-9ea1-96e9e40825cb tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1514 microversion: 2.1 time: 0.158412 Jan 31 04:51:18.168615 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 401/811] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:18 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:19.186142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-adc9e17f-c06f-4cd2-b1b1-1413f9f94988 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:19.186900 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-adc9e17f-c06f-4cd2-b1b1-1413f9f94988 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:19.193366 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-adc9e17f-c06f-4cd2-b1b1-1413f9f94988 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:19.193809 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-adc9e17f-c06f-4cd2-b1b1-1413f9f94988 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:19.198419 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-adc9e17f-c06f-4cd2-b1b1-1413f9f94988 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:19.198419 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-adc9e17f-c06f-4cd2-b1b1-1413f9f94988 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:19.334637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-adc9e17f-c06f-4cd2-b1b1-1413f9f94988 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:19.342268 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-adc9e17f-c06f-4cd2-b1b1-1413f9f94988 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1514 microversion: 2.1 time: 0.160703 Jan 31 04:51:19.343308 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 411/812] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:19 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:20.360339 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a7215a18-3286-414d-8afc-f8ad7f83ff02 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:20.361325 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a7215a18-3286-414d-8afc-f8ad7f83ff02 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:20.368312 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a7215a18-3286-414d-8afc-f8ad7f83ff02 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:20.369011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a7215a18-3286-414d-8afc-f8ad7f83ff02 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:20.369864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a7215a18-3286-414d-8afc-f8ad7f83ff02 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:20.370417 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a7215a18-3286-414d-8afc-f8ad7f83ff02 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:20.527199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a7215a18-3286-414d-8afc-f8ad7f83ff02 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:20.539551 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a7215a18-3286-414d-8afc-f8ad7f83ff02 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 200 len: 1514 microversion: 2.1 time: 0.183574 Jan 31 04:51:20.540340 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 402/813] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:20 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:20.624540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-ba6cd903-85d5-4dfd-b0af-b98b4a748ccb req-3d9d4827-8064-4bcf-a479-c272fc7a4239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb76b92c-8a69-4296-ac1a-e92639dfc36d", "name": "network-vif-deleted", "tag": "a9fc9791-5ebe-4263-9f37-63c51001fb39"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:51:20.626363 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:51:20.626363 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:51:20.639131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ba6cd903-85d5-4dfd-b0af-b98b4a748ccb req-3d9d4827-8064-4bcf-a479-c272fc7a4239 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:20.639131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ba6cd903-85d5-4dfd-b0af-b98b4a748ccb req-3d9d4827-8064-4bcf-a479-c272fc7a4239 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:20.650138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-ba6cd903-85d5-4dfd-b0af-b98b4a748ccb req-3d9d4827-8064-4bcf-a479-c272fc7a4239 service nova] Creating event network-vif-deleted:a9fc9791-5ebe-4263-9f37-63c51001fb39 for instance eb76b92c-8a69-4296-ac1a-e92639dfc36d on hv-cinder-82660 Jan 31 04:51:20.655025 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-ba6cd903-85d5-4dfd-b0af-b98b4a748ccb req-3d9d4827-8064-4bcf-a479-c272fc7a4239 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034942 Jan 31 04:51:20.655612 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 412/814] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:51:21.556580 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:21.557134 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: eb76b92c-8a69-4296-ac1a-e92639dfc36d] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:21.563578 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:21.564716 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:21.564877 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:21.565216 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:21.580428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] HTTP exception thrown: Instance eb76b92c-8a69-4296-ac1a-e92639dfc36d could not be found. Jan 31 04:51:21.581029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Returning 404 to user: Instance eb76b92c-8a69-4296-ac1a-e92639dfc36d could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:51:21.582102 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7a1d5114-0801-4115-8e6d-a6e17929b891 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d" status: 404 len: 111 microversion: 2.1 time: 0.029086 Jan 31 04:51:21.582592 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 403/815] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:21 2022] GET /compute/v2.1/servers/eb76b92c-8a69-4296-ac1a-e92639dfc36d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:51:34.151774 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-756961530", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "networks": [{"uuid": "4c106be3-7d30-4345-b394-72d02e51853a"}]}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:51:34.201931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] validate_networks() for [('4c106be3-7d30-4345-b394-72d02e51853a', None, None, None, None, None)] {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:51:34.627171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:51:34.627589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:51:34.628087 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:51:34.628487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:51:34.628888 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:51:34.637231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:34.637664 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:34.638453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:34.638915 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:34.655117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Getting quotas for project 32bc488217794302b16e40a559bec3c8. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:51:34.659093 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Getting quotas for user 67b2e5f365144062bd2612f5d3ebd077 and project 32bc488217794302b16e40a559bec3c8. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:51:34.669307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:51:34.671643 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:51:34.793863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-563de8f9-6c64-4f2a-a226-85d6da1213c2 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646624 Jan 31 04:51:34.794512 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 413/816] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:51:34.804968 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-db8f99b6-a593-407e-9a5b-11b64bb31d83 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:34.805579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-db8f99b6-a593-407e-9a5b-11b64bb31d83 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:34.855867 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-db8f99b6-a593-407e-9a5b-11b64bb31d83 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:34.863943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-db8f99b6-a593-407e-9a5b-11b64bb31d83 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1218 microversion: 2.1 time: 0.062710 Jan 31 04:51:34.864623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 404/817] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:34 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:35.882332 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-74d3e1c0-5550-42e0-bd00-e6ae10846553 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:35.882902 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-74d3e1c0-5550-42e0-bd00-e6ae10846553 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:35.888928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74d3e1c0-5550-42e0-bd00-e6ae10846553 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:35.889376 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74d3e1c0-5550-42e0-bd00-e6ae10846553 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:35.890136 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74d3e1c0-5550-42e0-bd00-e6ae10846553 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:35.890563 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74d3e1c0-5550-42e0-bd00-e6ae10846553 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:35.951260 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-74d3e1c0-5550-42e0-bd00-e6ae10846553 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:35.958938 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-74d3e1c0-5550-42e0-bd00-e6ae10846553 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1214 microversion: 2.1 time: 0.080688 Jan 31 04:51:35.959743 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 414/818] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:35 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:36.975792 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0653659f-c1c2-48a9-8362-b81cb7cbaba4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:36.976403 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0653659f-c1c2-48a9-8362-b81cb7cbaba4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:36.983356 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0653659f-c1c2-48a9-8362-b81cb7cbaba4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:36.983799 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0653659f-c1c2-48a9-8362-b81cb7cbaba4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:36.984569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0653659f-c1c2-48a9-8362-b81cb7cbaba4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:36.985011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0653659f-c1c2-48a9-8362-b81cb7cbaba4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:37.045238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0653659f-c1c2-48a9-8362-b81cb7cbaba4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:37.053358 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0653659f-c1c2-48a9-8362-b81cb7cbaba4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1276 microversion: 2.1 time: 0.081272 Jan 31 04:51:37.053918 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 405/819] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:36 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1276 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:38.075029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e29fe206-4634-4189-8da9-440d6ec5012c tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:38.075029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e29fe206-4634-4189-8da9-440d6ec5012c tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:38.075730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-1e6bd2dc-47ee-46db-b3b0-8788a866ee7f req-33fb125d-e31d-4162-b82a-a670c2d9ce26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22eee00a-7047-4e61-9f8b-13a0088f021b", "tag": "21617a0a-115f-4175-a000-66251ef8a020"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:51:38.076628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:51:38.076628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:51:38.085009 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-1e6bd2dc-47ee-46db-b3b0-8788a866ee7f req-33fb125d-e31d-4162-b82a-a670c2d9ce26 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:38.085463 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-1e6bd2dc-47ee-46db-b3b0-8788a866ee7f req-33fb125d-e31d-4162-b82a-a670c2d9ce26 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:38.096271 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29fe206-4634-4189-8da9-440d6ec5012c tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:38.096724 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29fe206-4634-4189-8da9-440d6ec5012c tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:38.097386 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-1e6bd2dc-47ee-46db-b3b0-8788a866ee7f req-33fb125d-e31d-4162-b82a-a670c2d9ce26 service nova] Creating event network-changed:21617a0a-115f-4175-a000-66251ef8a020 for instance 22eee00a-7047-4e61-9f8b-13a0088f021b on hv-cinder-82660 Jan 31 04:51:38.097497 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29fe206-4634-4189-8da9-440d6ec5012c tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:38.097948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29fe206-4634-4189-8da9-440d6ec5012c tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:38.102944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-1e6bd2dc-47ee-46db-b3b0-8788a866ee7f req-33fb125d-e31d-4162-b82a-a670c2d9ce26 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148803 Jan 31 04:51:38.103271 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 415/820] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:51:38.237414 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e29fe206-4634-4189-8da9-440d6ec5012c tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:38.244626 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e29fe206-4634-4189-8da9-440d6ec5012c tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1318 microversion: 2.1 time: 0.174294 Jan 31 04:51:38.245193 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 406/821] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:38 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:51:39.262975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-923353cf-6fd4-43d9-8a43-7e241d1fd9fa tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:39.263660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-923353cf-6fd4-43d9-8a43-7e241d1fd9fa tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:39.269784 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-923353cf-6fd4-43d9-8a43-7e241d1fd9fa tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:39.270221 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-923353cf-6fd4-43d9-8a43-7e241d1fd9fa tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:39.271011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-923353cf-6fd4-43d9-8a43-7e241d1fd9fa tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:39.271497 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-923353cf-6fd4-43d9-8a43-7e241d1fd9fa tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:39.408899 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-923353cf-6fd4-43d9-8a43-7e241d1fd9fa tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:39.416116 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-923353cf-6fd4-43d9-8a43-7e241d1fd9fa tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1318 microversion: 2.1 time: 0.157568 Jan 31 04:51:39.416675 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 416/822] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:39 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:40.433230 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1e1e5a7c-187c-4ec4-85e6-a39f3b663ef3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:40.433766 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1e1e5a7c-187c-4ec4-85e6-a39f3b663ef3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:40.441251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1e1e5a7c-187c-4ec4-85e6-a39f3b663ef3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:40.441691 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1e1e5a7c-187c-4ec4-85e6-a39f3b663ef3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:40.442482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1e1e5a7c-187c-4ec4-85e6-a39f3b663ef3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:40.442929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1e1e5a7c-187c-4ec4-85e6-a39f3b663ef3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:40.571290 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1e1e5a7c-187c-4ec4-85e6-a39f3b663ef3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:40.578326 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1e1e5a7c-187c-4ec4-85e6-a39f3b663ef3 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1318 microversion: 2.1 time: 0.148775 Jan 31 04:51:40.579004 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 407/823] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:40 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:41.595274 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ec551151-e061-44c3-82f1-bd6ea9d97a2b tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:41.595832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ec551151-e061-44c3-82f1-bd6ea9d97a2b tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:41.602068 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec551151-e061-44c3-82f1-bd6ea9d97a2b tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:41.602507 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec551151-e061-44c3-82f1-bd6ea9d97a2b tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:41.603309 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec551151-e061-44c3-82f1-bd6ea9d97a2b tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:41.603738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ec551151-e061-44c3-82f1-bd6ea9d97a2b tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:41.732583 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ec551151-e061-44c3-82f1-bd6ea9d97a2b tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:41.740548 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ec551151-e061-44c3-82f1-bd6ea9d97a2b tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1318 microversion: 2.1 time: 0.149236 Jan 31 04:51:41.741109 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 417/824] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:41 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:42.757898 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-afcdd0b7-3b38-4431-ba33-014110e1f4ff tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:42.758648 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-afcdd0b7-3b38-4431-ba33-014110e1f4ff tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:42.764905 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-afcdd0b7-3b38-4431-ba33-014110e1f4ff tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:42.765345 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-afcdd0b7-3b38-4431-ba33-014110e1f4ff tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:42.766113 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-afcdd0b7-3b38-4431-ba33-014110e1f4ff tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:42.766604 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-afcdd0b7-3b38-4431-ba33-014110e1f4ff tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:42.871948 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-22c0bb18-3087-47af-8560-294b4d5fd717 req-20eabba0-cb37-46ee-835d-8f0f931c2b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eee00a-7047-4e61-9f8b-13a0088f021b", "name": "network-vif-plugged", "status": "completed", "tag": "21617a0a-115f-4175-a000-66251ef8a020"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:51:42.873466 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:51:42.873466 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:51:42.881282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-22c0bb18-3087-47af-8560-294b4d5fd717 req-20eabba0-cb37-46ee-835d-8f0f931c2b8d service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:42.881711 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-22c0bb18-3087-47af-8560-294b4d5fd717 req-20eabba0-cb37-46ee-835d-8f0f931c2b8d service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:42.893949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-22c0bb18-3087-47af-8560-294b4d5fd717 req-20eabba0-cb37-46ee-835d-8f0f931c2b8d service nova] Creating event network-vif-plugged:21617a0a-115f-4175-a000-66251ef8a020 for instance 22eee00a-7047-4e61-9f8b-13a0088f021b on hv-cinder-82660 Jan 31 04:51:42.899505 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-22c0bb18-3087-47af-8560-294b4d5fd717 req-20eabba0-cb37-46ee-835d-8f0f931c2b8d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087857 Jan 31 04:51:42.900104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 418/825] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:51:42.904032 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-afcdd0b7-3b38-4431-ba33-014110e1f4ff tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:42.911755 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-afcdd0b7-3b38-4431-ba33-014110e1f4ff tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1318 microversion: 2.1 time: 0.157474 Jan 31 04:51:42.912322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 408/826] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:42 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:43.928439 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-56ea8d16-dc6e-4e41-a4ee-38fc43e93626 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:43.929153 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-56ea8d16-dc6e-4e41-a4ee-38fc43e93626 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:43.935593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-56ea8d16-dc6e-4e41-a4ee-38fc43e93626 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:43.936030 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-56ea8d16-dc6e-4e41-a4ee-38fc43e93626 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:43.936782 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-56ea8d16-dc6e-4e41-a4ee-38fc43e93626 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:43.937208 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-56ea8d16-dc6e-4e41-a4ee-38fc43e93626 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:44.068935 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-56ea8d16-dc6e-4e41-a4ee-38fc43e93626 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:44.076012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-56ea8d16-dc6e-4e41-a4ee-38fc43e93626 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1318 microversion: 2.1 time: 0.151498 Jan 31 04:51:44.076567 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 419/827] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:43 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:45.096524 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a71edc2b-528d-4bdb-bcd2-beacb41ff549 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:45.097136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a71edc2b-528d-4bdb-bcd2-beacb41ff549 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:45.103086 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a71edc2b-528d-4bdb-bcd2-beacb41ff549 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:45.103537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a71edc2b-528d-4bdb-bcd2-beacb41ff549 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:45.104373 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a71edc2b-528d-4bdb-bcd2-beacb41ff549 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:45.104808 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a71edc2b-528d-4bdb-bcd2-beacb41ff549 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:45.243481 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a71edc2b-528d-4bdb-bcd2-beacb41ff549 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:45.251422 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a71edc2b-528d-4bdb-bcd2-beacb41ff549 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1318 microversion: 2.1 time: 0.158535 Jan 31 04:51:45.251996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 409/828] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:45 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:46.269006 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-872cfd6b-c08a-4f74-9517-ba447bff6127 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:51:46.269666 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-872cfd6b-c08a-4f74-9517-ba447bff6127 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:46.275995 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-872cfd6b-c08a-4f74-9517-ba447bff6127 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:46.276440 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-872cfd6b-c08a-4f74-9517-ba447bff6127 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:46.277210 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-872cfd6b-c08a-4f74-9517-ba447bff6127 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:46.277642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-872cfd6b-c08a-4f74-9517-ba447bff6127 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:46.407527 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-872cfd6b-c08a-4f74-9517-ba447bff6127 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:51:46.414780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-872cfd6b-c08a-4f74-9517-ba447bff6127 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1506 microversion: 2.1 time: 0.150378 Jan 31 04:51:46.415361 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 420/829] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:51:46 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:51:46.430875 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-976e982b-ab12-4347-8518-358c4968b7b0 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a05fb037-a1c5-4979-aaf9-073465a57644", "device": "/dev/sdb"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:51:46.432546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-976e982b-ab12-4347-8518-358c4968b7b0 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:51:46.439000 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-976e982b-ab12-4347-8518-358c4968b7b0 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:46.439455 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-976e982b-ab12-4347-8518-358c4968b7b0 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:46.440227 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-976e982b-ab12-4347-8518-358c4968b7b0 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:51:46.440663 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-976e982b-ab12-4347-8518-358c4968b7b0 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:51:47.121931 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-976e982b-ab12-4347-8518-358c4968b7b0 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "POST /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694626 Jan 31 04:51:47.122547 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 410/830] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:51:46 2022] POST /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:52:05.843584 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6c584c25-91f7-4314-ba31-2b00b33a6bdd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:05.844181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6c584c25-91f7-4314-ba31-2b00b33a6bdd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:05.849985 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c584c25-91f7-4314-ba31-2b00b33a6bdd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:05.850428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c584c25-91f7-4314-ba31-2b00b33a6bdd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:05.851223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c584c25-91f7-4314-ba31-2b00b33a6bdd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:05.851650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c584c25-91f7-4314-ba31-2b00b33a6bdd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:05.927748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-6c584c25-91f7-4314-ba31-2b00b33a6bdd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lazy-loading 'services' on Instance uuid 2b864423-6740-4f17-848e-ab7213f4ceab {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:52:06.065817 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6c584c25-91f7-4314-ba31-2b00b33a6bdd tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/os-volume_attachments/98a39f50-228d-473f-838f-208b9d06fda7" status: 202 len: 0 microversion: 2.1 time: 0.225646 Jan 31 04:52:06.066400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 421/831] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:52:05 2022] DELETE /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/os-volume_attachments/98a39f50-228d-473f-838f-208b9d06fda7 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:52:07.172925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a6ef3215-0d33-4069-b696-56b6bee911e5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:07.182163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6ef3215-0d33-4069-b696-56b6bee911e5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:07.182607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6ef3215-0d33-4069-b696-56b6bee911e5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:07.242261 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a6ef3215-0d33-4069-b696-56b6bee911e5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Going to try to stop instance {{(pid=123367) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 31 04:52:07.469990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a6ef3215-0d33-4069-b696-56b6bee911e5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/action" status: 202 len: 0 microversion: 2.1 time: 0.301001 Jan 31 04:52:07.475516 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 411/832] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:52:07 2022] POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:52:07.479294 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-578426fa-e73d-432c-96ae-f184b3edeb67 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:07.480002 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-578426fa-e73d-432c-96ae-f184b3edeb67 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:07.486339 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-578426fa-e73d-432c-96ae-f184b3edeb67 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:07.486809 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-578426fa-e73d-432c-96ae-f184b3edeb67 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:07.487598 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-578426fa-e73d-432c-96ae-f184b3edeb67 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:07.488035 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-578426fa-e73d-432c-96ae-f184b3edeb67 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:07.623897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-578426fa-e73d-432c-96ae-f184b3edeb67 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:07.631384 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-578426fa-e73d-432c-96ae-f184b3edeb67 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.156400 Jan 31 04:52:07.631957 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 422/833] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:07 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:08.649461 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ea6886b0-126f-46c6-b0ee-9cb9067f2977 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:08.650152 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ea6886b0-126f-46c6-b0ee-9cb9067f2977 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:08.656502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea6886b0-126f-46c6-b0ee-9cb9067f2977 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:08.656943 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea6886b0-126f-46c6-b0ee-9cb9067f2977 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:08.657706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea6886b0-126f-46c6-b0ee-9cb9067f2977 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:08.658134 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ea6886b0-126f-46c6-b0ee-9cb9067f2977 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:08.789059 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ea6886b0-126f-46c6-b0ee-9cb9067f2977 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:08.796629 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ea6886b0-126f-46c6-b0ee-9cb9067f2977 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.152077 Jan 31 04:52:08.797187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 412/834] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:08 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:09.907901 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b511eb22-10b1-4a17-8707-5970e3149d74 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:09.908510 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b511eb22-10b1-4a17-8707-5970e3149d74 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:09.914189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b511eb22-10b1-4a17-8707-5970e3149d74 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:09.915248 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b511eb22-10b1-4a17-8707-5970e3149d74 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:09.916154 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b511eb22-10b1-4a17-8707-5970e3149d74 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:09.916628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b511eb22-10b1-4a17-8707-5970e3149d74 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:09.937533 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-20137c2e-ff32-4748-badb-baa689d4f0e4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:09.938052 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-20137c2e-ff32-4748-badb-baa689d4f0e4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:09.944871 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-20137c2e-ff32-4748-badb-baa689d4f0e4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:09.945322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-20137c2e-ff32-4748-badb-baa689d4f0e4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:09.946097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-20137c2e-ff32-4748-badb-baa689d4f0e4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:09.946537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-20137c2e-ff32-4748-badb-baa689d4f0e4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:10.024333 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-20137c2e-ff32-4748-badb-baa689d4f0e4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lazy-loading 'services' on Instance uuid 22eee00a-7047-4e61-9f8b-13a0088f021b {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:52:10.047386 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b511eb22-10b1-4a17-8707-5970e3149d74 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:10.055445 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b511eb22-10b1-4a17-8707-5970e3149d74 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.245944 Jan 31 04:52:10.056012 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 423/835] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:09 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:10.254105 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-20137c2e-ff32-4748-badb-baa689d4f0e4 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "DELETE /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b/os-volume_attachments/a05fb037-a1c5-4979-aaf9-073465a57644" status: 202 len: 0 microversion: 2.1 time: 0.320189 Jan 31 04:52:10.254766 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 413/836] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:52:09 2022] DELETE /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b/os-volume_attachments/a05fb037-a1c5-4979-aaf9-073465a57644 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 04:52:11.072142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ba2ce439-74a4-43bc-963a-6630a6c7f226 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:11.072814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ba2ce439-74a4-43bc-963a-6630a6c7f226 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:11.079192 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ba2ce439-74a4-43bc-963a-6630a6c7f226 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:11.084476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ba2ce439-74a4-43bc-963a-6630a6c7f226 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:11.084476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ba2ce439-74a4-43bc-963a-6630a6c7f226 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:11.084476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ba2ce439-74a4-43bc-963a-6630a6c7f226 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:11.226000 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ba2ce439-74a4-43bc-963a-6630a6c7f226 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:11.233266 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ba2ce439-74a4-43bc-963a-6630a6c7f226 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.165586 Jan 31 04:52:11.233833 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 424/837] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:11 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:12.249837 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-aa856fef-5291-40b3-b6cf-cea6b064ffff tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:12.250782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-aa856fef-5291-40b3-b6cf-cea6b064ffff tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:12.257190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aa856fef-5291-40b3-b6cf-cea6b064ffff tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:12.257624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aa856fef-5291-40b3-b6cf-cea6b064ffff tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:12.258377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aa856fef-5291-40b3-b6cf-cea6b064ffff tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:12.258814 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aa856fef-5291-40b3-b6cf-cea6b064ffff tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:12.392701 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-aa856fef-5291-40b3-b6cf-cea6b064ffff tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:12.400798 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-aa856fef-5291-40b3-b6cf-cea6b064ffff tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.155336 Jan 31 04:52:12.401436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 414/838] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:12 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:12.410852 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-63777574-dbfb-4cc4-abd1-c56b1288bba5 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:12.411960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-63777574-dbfb-4cc4-abd1-c56b1288bba5 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:12.418126 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-63777574-dbfb-4cc4-abd1-c56b1288bba5 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:12.418563 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-63777574-dbfb-4cc4-abd1-c56b1288bba5 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:12.419341 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-63777574-dbfb-4cc4-abd1-c56b1288bba5 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:12.419768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-63777574-dbfb-4cc4-abd1-c56b1288bba5 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:12.443451 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-63777574-dbfb-4cc4-abd1-c56b1288bba5 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:52:12.712107 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-63777574-dbfb-4cc4-abd1-c56b1288bba5 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "DELETE /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 204 len: 0 microversion: 2.1 time: 0.304531 Jan 31 04:52:12.712730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 425/839] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:52:12 2022] DELETE /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:52:12.720434 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-92d17462-15c1-48ba-bff0-b146d3ad0450 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:12.727437 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-92d17462-15c1-48ba-bff0-b146d3ad0450 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:12.727566 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92d17462-15c1-48ba-bff0-b146d3ad0450 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:12.727995 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92d17462-15c1-48ba-bff0-b146d3ad0450 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:12.728762 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92d17462-15c1-48ba-bff0-b146d3ad0450 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:12.729195 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92d17462-15c1-48ba-bff0-b146d3ad0450 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:12.858683 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-92d17462-15c1-48ba-bff0-b146d3ad0450 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:12.866160 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-92d17462-15c1-48ba-bff0-b146d3ad0450 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1512 microversion: 2.1 time: 0.149307 Jan 31 04:52:12.866709 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 415/840] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:12 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:12.947817 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 04:52:12.948019 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 04:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 04:52:13.417823 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-485e93f5-3cd7-4df2-bb62-d9dad7fd8de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:13.418459 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-485e93f5-3cd7-4df2-bb62-d9dad7fd8de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:13.424743 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-485e93f5-3cd7-4df2-bb62-d9dad7fd8de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:13.425196 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-485e93f5-3cd7-4df2-bb62-d9dad7fd8de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:13.425961 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-485e93f5-3cd7-4df2-bb62-d9dad7fd8de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:13.426392 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-485e93f5-3cd7-4df2-bb62-d9dad7fd8de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:13.560405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-485e93f5-3cd7-4df2-bb62-d9dad7fd8de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:13.567586 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-485e93f5-3cd7-4df2-bb62-d9dad7fd8de7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.153876 Jan 31 04:52:13.568134 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 426/841] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:13 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:13.883945 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-328e0f05-1743-430a-8b2d-f31834514dee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:13.884539 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-328e0f05-1743-430a-8b2d-f31834514dee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:13.890679 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-328e0f05-1743-430a-8b2d-f31834514dee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:13.892025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-328e0f05-1743-430a-8b2d-f31834514dee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:13.892025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-328e0f05-1743-430a-8b2d-f31834514dee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:13.892424 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-328e0f05-1743-430a-8b2d-f31834514dee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:14.019767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-328e0f05-1743-430a-8b2d-f31834514dee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:14.027008 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-328e0f05-1743-430a-8b2d-f31834514dee tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1512 microversion: 2.1 time: 0.147387 Jan 31 04:52:14.027574 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 416/842] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:13 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:14.584358 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1dc8be0b-813b-4ba2-abb6-387d0f61eece tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:14.584877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1dc8be0b-813b-4ba2-abb6-387d0f61eece tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:14.591150 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1dc8be0b-813b-4ba2-abb6-387d0f61eece tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:14.591592 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1dc8be0b-813b-4ba2-abb6-387d0f61eece tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:14.592356 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1dc8be0b-813b-4ba2-abb6-387d0f61eece tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:14.592784 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1dc8be0b-813b-4ba2-abb6-387d0f61eece tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:14.801519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1dc8be0b-813b-4ba2-abb6-387d0f61eece tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:14.808665 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1dc8be0b-813b-4ba2-abb6-387d0f61eece tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.228044 Jan 31 04:52:14.809229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 427/843] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:14 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:15.042838 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f307d740-d14f-4d8f-a23b-8c146425d29e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:15.043436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f307d740-d14f-4d8f-a23b-8c146425d29e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:15.049564 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f307d740-d14f-4d8f-a23b-8c146425d29e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:15.050007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f307d740-d14f-4d8f-a23b-8c146425d29e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:15.050767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f307d740-d14f-4d8f-a23b-8c146425d29e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:15.051220 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f307d740-d14f-4d8f-a23b-8c146425d29e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:15.194080 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f307d740-d14f-4d8f-a23b-8c146425d29e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b2e5f365144062bd2612f5d3ebd077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bc488217794302b16e40a559bec3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:15.201802 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f307d740-d14f-4d8f-a23b-8c146425d29e tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 200 len: 1512 microversion: 2.1 time: 0.162568 Jan 31 04:52:15.202457 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 417/844] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:15 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:15.227162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-eaea2da5-3246-4123-9024-72b2e8152a3c req-ba9c31e4-601e-48dd-a698-85959db82a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eee00a-7047-4e61-9f8b-13a0088f021b", "name": "network-vif-deleted", "tag": "21617a0a-115f-4175-a000-66251ef8a020"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:15.228754 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:52:15.228754 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:52:15.235624 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-eaea2da5-3246-4123-9024-72b2e8152a3c req-ba9c31e4-601e-48dd-a698-85959db82a36 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:15.237994 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-eaea2da5-3246-4123-9024-72b2e8152a3c req-ba9c31e4-601e-48dd-a698-85959db82a36 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:15.246702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-eaea2da5-3246-4123-9024-72b2e8152a3c req-ba9c31e4-601e-48dd-a698-85959db82a36 service nova] Creating event network-vif-deleted:21617a0a-115f-4175-a000-66251ef8a020 for instance 22eee00a-7047-4e61-9f8b-13a0088f021b on hv-cinder-82660 Jan 31 04:52:15.251808 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-eaea2da5-3246-4123-9024-72b2e8152a3c req-ba9c31e4-601e-48dd-a698-85959db82a36 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028224 Jan 31 04:52:15.252417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 428/845] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:52:15.824956 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7f75b039-affb-4eb4-b7b4-3303de7117aa tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:15.825560 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7f75b039-affb-4eb4-b7b4-3303de7117aa tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:15.831333 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f75b039-affb-4eb4-b7b4-3303de7117aa tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:15.831770 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f75b039-affb-4eb4-b7b4-3303de7117aa tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:15.832534 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f75b039-affb-4eb4-b7b4-3303de7117aa tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:15.833559 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7f75b039-affb-4eb4-b7b4-3303de7117aa tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:15.962654 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7f75b039-affb-4eb4-b7b4-3303de7117aa tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:15.970142 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7f75b039-affb-4eb4-b7b4-3303de7117aa tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.148722 Jan 31 04:52:15.970702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 418/846] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:15 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:16.220310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:16.221036 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] [instance: 22eee00a-7047-4e61-9f8b-13a0088f021b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:16.227792 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:16.228267 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:16.229043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:16.229474 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:16.243195 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] HTTP exception thrown: Instance 22eee00a-7047-4e61-9f8b-13a0088f021b could not be found. Jan 31 04:52:16.243776 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] Returning 404 to user: Instance 22eee00a-7047-4e61-9f8b-13a0088f021b could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:52:16.244698 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3cdfe5de-ae05-4851-b71e-55abf65872f6 tempest-VolumesSnapshotTestJSON-378395015 tempest-VolumesSnapshotTestJSON-378395015-project] 10.222.0.21 "GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b" status: 404 len: 111 microversion: 2.1 time: 0.028433 Jan 31 04:52:16.245220 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 429/847] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:16 2022] GET /compute/v2.1/servers/22eee00a-7047-4e61-9f8b-13a0088f021b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:52:16.987355 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-06510150-4204-43fa-b902-bd3aabf8a93d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:16.987958 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-06510150-4204-43fa-b902-bd3aabf8a93d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:16.994190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06510150-4204-43fa-b902-bd3aabf8a93d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:16.994627 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06510150-4204-43fa-b902-bd3aabf8a93d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:16.995460 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06510150-4204-43fa-b902-bd3aabf8a93d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:16.995831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06510150-4204-43fa-b902-bd3aabf8a93d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:17.129057 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-06510150-4204-43fa-b902-bd3aabf8a93d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:17.136727 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-06510150-4204-43fa-b902-bd3aabf8a93d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1679 microversion: 2.1 time: 0.153121 Jan 31 04:52:17.137286 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 419/848] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:16 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:18.153410 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9961d7c3-fb60-470a-9946-325a2240d57f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:18.154020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9961d7c3-fb60-470a-9946-325a2240d57f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:18.160531 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9961d7c3-fb60-470a-9946-325a2240d57f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:18.160981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9961d7c3-fb60-470a-9946-325a2240d57f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:18.161758 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9961d7c3-fb60-470a-9946-325a2240d57f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:18.162251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9961d7c3-fb60-470a-9946-325a2240d57f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:18.300579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9961d7c3-fb60-470a-9946-325a2240d57f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:18.307781 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9961d7c3-fb60-470a-9946-325a2240d57f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1656 microversion: 2.1 time: 0.158119 Jan 31 04:52:18.308333 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 430/849] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:18 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:18.324348 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-81fb475e-6136-4d35-a4a4-6976c431180e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:18.330589 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-81fb475e-6136-4d35-a4a4-6976c431180e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:18.331059 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-81fb475e-6136-4d35-a4a4-6976c431180e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:18.353837 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-81fb475e-6136-4d35-a4a4-6976c431180e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Going to try to start instance {{(pid=123367) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 31 04:52:18.520800 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-81fb475e-6136-4d35-a4a4-6976c431180e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/action" status: 202 len: 0 microversion: 2.1 time: 0.199913 Jan 31 04:52:18.521453 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 420/850] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:52:18 2022] POST /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:52:18.529462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b305bedd-cf9a-45f7-9d42-bf8b9055d5c4 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:18.530096 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b305bedd-cf9a-45f7-9d42-bf8b9055d5c4 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:18.535850 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b305bedd-cf9a-45f7-9d42-bf8b9055d5c4 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:18.536291 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b305bedd-cf9a-45f7-9d42-bf8b9055d5c4 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:18.537180 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b305bedd-cf9a-45f7-9d42-bf8b9055d5c4 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:18.537883 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b305bedd-cf9a-45f7-9d42-bf8b9055d5c4 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:18.678298 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b305bedd-cf9a-45f7-9d42-bf8b9055d5c4 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:18.685817 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b305bedd-cf9a-45f7-9d42-bf8b9055d5c4 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1665 microversion: 2.1 time: 0.160144 Jan 31 04:52:18.686391 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 431/851] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:18 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:19.704985 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-49587c79-f57a-483c-989d-93b2ca116bc5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:19.705686 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-49587c79-f57a-483c-989d-93b2ca116bc5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:19.711896 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49587c79-f57a-483c-989d-93b2ca116bc5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:19.712339 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49587c79-f57a-483c-989d-93b2ca116bc5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:19.713124 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49587c79-f57a-483c-989d-93b2ca116bc5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:19.713556 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49587c79-f57a-483c-989d-93b2ca116bc5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:19.844098 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-49587c79-f57a-483c-989d-93b2ca116bc5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:19.851928 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-49587c79-f57a-483c-989d-93b2ca116bc5 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1665 microversion: 2.1 time: 0.151385 Jan 31 04:52:19.852488 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 421/852] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:19 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:20.869215 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1f384448-5a85-4356-8268-cc2834a66433 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:20.869832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1f384448-5a85-4356-8268-cc2834a66433 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:20.876429 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f384448-5a85-4356-8268-cc2834a66433 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:20.876876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f384448-5a85-4356-8268-cc2834a66433 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:20.877644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f384448-5a85-4356-8268-cc2834a66433 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:20.878077 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f384448-5a85-4356-8268-cc2834a66433 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:21.009268 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1f384448-5a85-4356-8268-cc2834a66433 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:21.016489 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1f384448-5a85-4356-8268-cc2834a66433 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1665 microversion: 2.1 time: 0.151549 Jan 31 04:52:21.017044 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 432/853] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:20 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:22.033192 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-db089fd9-2600-4295-8ba6-dd2539ce1fe2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:22.033763 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-db089fd9-2600-4295-8ba6-dd2539ce1fe2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:22.040412 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-db089fd9-2600-4295-8ba6-dd2539ce1fe2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:22.040857 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-db089fd9-2600-4295-8ba6-dd2539ce1fe2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:22.041626 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-db089fd9-2600-4295-8ba6-dd2539ce1fe2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:22.042060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-db089fd9-2600-4295-8ba6-dd2539ce1fe2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:22.174706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-db089fd9-2600-4295-8ba6-dd2539ce1fe2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:22.182852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-db089fd9-2600-4295-8ba6-dd2539ce1fe2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1665 microversion: 2.1 time: 0.153290 Jan 31 04:52:22.183407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 422/854] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:22 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:23.200319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7715536d-8c9c-40ca-b6e5-3274461dc8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:23.200968 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7715536d-8c9c-40ca-b6e5-3274461dc8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:23.207011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7715536d-8c9c-40ca-b6e5-3274461dc8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:23.212816 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7715536d-8c9c-40ca-b6e5-3274461dc8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:23.212816 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7715536d-8c9c-40ca-b6e5-3274461dc8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:23.212816 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7715536d-8c9c-40ca-b6e5-3274461dc8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:23.342772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7715536d-8c9c-40ca-b6e5-3274461dc8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:23.350112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7715536d-8c9c-40ca-b6e5-3274461dc8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1669 microversion: 2.1 time: 0.153445 Jan 31 04:52:23.351283 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 433/855] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:52:23 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:31.816512 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bb779032-4fef-4bc1-ac57-45ec8df67d3a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:31.817111 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bb779032-4fef-4bc1-ac57-45ec8df67d3a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:31.823695 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bb779032-4fef-4bc1-ac57-45ec8df67d3a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:31.824139 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bb779032-4fef-4bc1-ac57-45ec8df67d3a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:31.824909 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bb779032-4fef-4bc1-ac57-45ec8df67d3a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:31.825338 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bb779032-4fef-4bc1-ac57-45ec8df67d3a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:31.852816 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bb779032-4fef-4bc1-ac57-45ec8df67d3a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments/978b12de-ba8f-4e5b-9100-f1f3561345cf" status: 200 len: 194 microversion: 2.20 time: 0.040098 Jan 31 04:52:31.853377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 423/856] 10.222.0.21 () {60 vars in 1453 bytes} [Mon Jan 31 04:52:31 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments/978b12de-ba8f-4e5b-9100-f1f3561345cf => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:52:31.912319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8c11b12d-7a8e-4c9f-8301-8b427c5b8f6b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:31.912815 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8c11b12d-7a8e-4c9f-8301-8b427c5b8f6b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:31.918945 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c11b12d-7a8e-4c9f-8301-8b427c5b8f6b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:31.919389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c11b12d-7a8e-4c9f-8301-8b427c5b8f6b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:31.920153 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c11b12d-7a8e-4c9f-8301-8b427c5b8f6b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:31.920585 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8c11b12d-7a8e-4c9f-8301-8b427c5b8f6b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:31.996695 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-8c11b12d-7a8e-4c9f-8301-8b427c5b8f6b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lazy-loading 'services' on Instance uuid dde1517d-e13d-455c-a8dd-0119bb29148b {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:52:32.203179 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8c11b12d-7a8e-4c9f-8301-8b427c5b8f6b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "DELETE /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments/978b12de-ba8f-4e5b-9100-f1f3561345cf" status: 202 len: 0 microversion: 2.20 time: 0.294459 Jan 31 04:52:32.203774 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 434/857] 10.222.0.21 () {60 vars in 1456 bytes} [Mon Jan 31 04:52:31 2022] DELETE /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments/978b12de-ba8f-4e5b-9100-f1f3561345cf => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:52:32.212715 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3d47b326-ae81-40e1-8ec7-a31a01a6bc99 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:32.214022 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3d47b326-ae81-40e1-8ec7-a31a01a6bc99 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:32.219752 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d47b326-ae81-40e1-8ec7-a31a01a6bc99 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:32.220188 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d47b326-ae81-40e1-8ec7-a31a01a6bc99 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:32.220954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d47b326-ae81-40e1-8ec7-a31a01a6bc99 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:32.221379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d47b326-ae81-40e1-8ec7-a31a01a6bc99 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:32.249937 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3d47b326-ae81-40e1-8ec7-a31a01a6bc99 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041557 Jan 31 04:52:32.250472 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 424/858] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Jan 31 04:52:32 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:52:33.262968 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ede27dd8-84b7-4e83-bf15-034e4941b778 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:33.263975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ede27dd8-84b7-4e83-bf15-034e4941b778 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:33.269959 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ede27dd8-84b7-4e83-bf15-034e4941b778 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:33.270368 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ede27dd8-84b7-4e83-bf15-034e4941b778 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:33.271163 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ede27dd8-84b7-4e83-bf15-034e4941b778 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:33.271596 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ede27dd8-84b7-4e83-bf15-034e4941b778 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:33.301129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ede27dd8-84b7-4e83-bf15-034e4941b778 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043019 Jan 31 04:52:33.301681 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 435/859] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Jan 31 04:52:33 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:52:34.312523 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9d52390e-cb6d-413b-b3a8-df4bc8df6498 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:34.313479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9d52390e-cb6d-413b-b3a8-df4bc8df6498 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:34.319630 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9d52390e-cb6d-413b-b3a8-df4bc8df6498 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:34.320063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9d52390e-cb6d-413b-b3a8-df4bc8df6498 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:34.320858 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9d52390e-cb6d-413b-b3a8-df4bc8df6498 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:34.325853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9d52390e-cb6d-413b-b3a8-df4bc8df6498 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:34.350875 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9d52390e-cb6d-413b-b3a8-df4bc8df6498 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042064 Jan 31 04:52:34.351419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 425/860] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Jan 31 04:52:34 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:34.408107 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5a347249-3bcf-4e5f-80ed-42ec74ec55bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:34.408603 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5a347249-3bcf-4e5f-80ed-42ec74ec55bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:34.414993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5a347249-3bcf-4e5f-80ed-42ec74ec55bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:34.415443 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5a347249-3bcf-4e5f-80ed-42ec74ec55bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:34.416216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5a347249-3bcf-4e5f-80ed-42ec74ec55bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:34.416650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5a347249-3bcf-4e5f-80ed-42ec74ec55bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:34.440229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5a347249-3bcf-4e5f-80ed-42ec74ec55bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:52:34.763136 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5a347249-3bcf-4e5f-80ed-42ec74ec55bc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "DELETE /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 204 len: 0 microversion: 2.20 time: 0.358337 Jan 31 04:52:34.763716 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 436/861] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Jan 31 04:52:34 2022] DELETE /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 31 04:52:34.771624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:34.772221 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:34.778711 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:34.779176 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:34.779931 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:34.780355 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:34.909278 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:34.917502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:34.919039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:34.920169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4aa0a1fc-095d-4815-8767-0c9c1c700b94 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.152179 Jan 31 04:52:34.920711 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 426/862] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:34 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:35.939019 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:35.939642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:35.945847 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:35.946558 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:35.947370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:35.947811 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:36.076911 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:36.084618 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:36.086190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:36.087340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7da25637-6274-4606-b9f9-52c2fdbd6ec1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.152600 Jan 31 04:52:36.087891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 437/863] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:35 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:37.105000 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:37.105630 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:37.111875 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:37.112318 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:37.113093 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:37.113531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:37.240091 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:37.249096 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:37.250871 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:37.252062 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9ac4bb0f-e933-414f-99c8-4cd5acf5e5a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1722 microversion: 2.20 time: 0.151597 Jan 31 04:52:37.252615 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 427/864] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:37 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:38.262339 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-ebfa07ae-a3dc-432b-a924-b68189e6eb83 req-99fc50f6-a852-4af3-a4b2-52c112b637b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde1517d-e13d-455c-a8dd-0119bb29148b", "name": "network-vif-deleted", "tag": "2eade66b-918f-4c8e-a64c-60d0ce7921a5"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:38.263636 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:52:38.263636 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:52:38.271289 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:38.272030 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ebfa07ae-a3dc-432b-a924-b68189e6eb83 req-99fc50f6-a852-4af3-a4b2-52c112b637b5 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:38.276098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ebfa07ae-a3dc-432b-a924-b68189e6eb83 req-99fc50f6-a852-4af3-a4b2-52c112b637b5 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:38.276252 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:38.282258 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:38.282980 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:38.283975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:38.284609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:38.284792 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-ebfa07ae-a3dc-432b-a924-b68189e6eb83 req-99fc50f6-a852-4af3-a4b2-52c112b637b5 service nova] Creating event network-vif-deleted:2eade66b-918f-4c8e-a64c-60d0ce7921a5 for instance dde1517d-e13d-455c-a8dd-0119bb29148b on hv-cinder-82660 Jan 31 04:52:38.292245 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-ebfa07ae-a3dc-432b-a924-b68189e6eb83 req-99fc50f6-a852-4af3-a4b2-52c112b637b5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034708 Jan 31 04:52:38.295745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 438/865] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:52:38.360730 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:38.370556 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:38.372090 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:38.373365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6a35ebe8-6e1f-47a1-b060-365550bbf4cc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 200 len: 1655 microversion: 2.20 time: 0.106337 Jan 31 04:52:38.374008 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 428/866] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:38 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 1655 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:39.393166 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:39.393798 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:39.401070 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:39.401519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:39.402303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:39.402741 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:39.417303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] HTTP exception thrown: Instance dde1517d-e13d-455c-a8dd-0119bb29148b could not be found. Jan 31 04:52:39.417889 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Returning 404 to user: Instance dde1517d-e13d-455c-a8dd-0119bb29148b could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:52:39.418841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-24216e60-eed8-4218-8876-e19d9221fcf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 404 len: 111 microversion: 2.20 time: 0.030225 Jan 31 04:52:39.419379 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 439/867] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:39 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 04:52:39.429623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-34ab2e9a-e2ba-42b4-8de9-ebf18e5c4be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '.version_select at 0x7f69f525f0d0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:39.518771 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-34ab2e9a-e2ba-42b4-8de9-ebf18e5c4be7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651864345" status: 204 len: 0 microversion: 2.20 time: 0.094724 Jan 31 04:52:39.519465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 429/868] 10.222.0.21 () {60 vars in 1258 bytes} [Mon Jan 31 04:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651864345 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 31 04:52:40.281424 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3baeb454-ebba-4907-9095-d6efed46b96c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'create', calling method: .version_select at 0x7f69f4a2d3a0>, body: {"keypair": {"name": "tempest-keypair-2117279196"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:40.295768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-3baeb454-ebba-4907-9095-d6efed46b96c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for project 3951fb700ad04745afa04a4b077da951. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:52:40.301802 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-3baeb454-ebba-4907-9095-d6efed46b96c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for user aa68ebb7220c4e6383128947fc970877 and project 3951fb700ad04745afa04a4b077da951. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:52:40.528338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-3baeb454-ebba-4907-9095-d6efed46b96c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for project 3951fb700ad04745afa04a4b077da951. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:52:40.532217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-3baeb454-ebba-4907-9095-d6efed46b96c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for user aa68ebb7220c4e6383128947fc970877 and project 3951fb700ad04745afa04a4b077da951. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:52:40.545880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3baeb454-ebba-4907-9095-d6efed46b96c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.268249 Jan 31 04:52:40.546468 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 440/869] 10.222.0.21 () {62 vars in 1198 bytes} [Mon Jan 31 04:52:40 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 269 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 31 04:52:42.742320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2039184554", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a3d49fc-fe05-4677-aa28-3de849a9cd8b"}], "security_groups": [{"name": "tempest-securitygroup--1919791375"}], "key_name": "tempest-keypair-2117279196", "user_data": "}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:42.888470 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] validate_networks() for [('6a3d49fc-fe05-4677-aa28-3de849a9cd8b', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:52:43.462872 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:52:43.463401 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:52:43.463966 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:52:43.464465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:52:43.464947 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:52:43.473467 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:43.473904 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:43.474727 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:43.475322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:43.491959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for project 3951fb700ad04745afa04a4b077da951. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:52:43.496558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Getting quotas for user aa68ebb7220c4e6383128947fc970877 and project 3951fb700ad04745afa04a4b077da951. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:52:43.507500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:52:43.509911 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:52:43.662407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d206bbf4-d39f-4521-b96b-dccc153be133 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.924629 Jan 31 04:52:43.668666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 430/870] 10.222.0.21 () {62 vars in 1187 bytes} [Mon Jan 31 04:52:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 31 04:52:43.674448 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b534baa0-8067-4ee9-9c70-89f1464786c8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:43.675075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b534baa0-8067-4ee9-9c70-89f1464786c8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:43.744506 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b534baa0-8067-4ee9-9c70-89f1464786c8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:43.755504 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b534baa0-8067-4ee9-9c70-89f1464786c8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:43.757623 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b534baa0-8067-4ee9-9c70-89f1464786c8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:43.759033 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b534baa0-8067-4ee9-9c70-89f1464786c8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1282 microversion: 2.20 time: 0.089043 Jan 31 04:52:43.768861 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 441/871] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:43 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:44.778856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:44.780223 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:44.786626 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:44.788119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:44.788119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:44.788334 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:44.852378 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:44.860040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:44.861508 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:44.862592 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-25c85c05-fe1b-4a0b-b046-1a67c52f0871 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1278 microversion: 2.20 time: 0.089355 Jan 31 04:52:44.863166 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 431/872] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:44 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:45.881934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:45.882546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:45.889492 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:45.889940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:45.890743 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:45.891211 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:45.982452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:45.996179 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:45.998232 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:45.999768 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-41d0bdb0-4b76-4bed-88ec-a2149568c75a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1340 microversion: 2.20 time: 0.122331 Jan 31 04:52:46.000522 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 442/873] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:45 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1340 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:47.024741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:47.026249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:47.040605 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:47.043537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:47.045316 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:47.046041 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:47.320690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-313ee4ee-eb25-4945-a662-96daf56ecf69 req-b5c7cc0d-cc1e-48c2-aeb2-f4e577e9ded2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c83adf7-7265-467f-a4cc-1d9d0252b24f", "tag": "1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:47.322453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:52:47.322453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:52:47.328902 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:47.358400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-313ee4ee-eb25-4945-a662-96daf56ecf69 req-b5c7cc0d-cc1e-48c2-aeb2-f4e577e9ded2 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:47.359950 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-313ee4ee-eb25-4945-a662-96daf56ecf69 req-b5c7cc0d-cc1e-48c2-aeb2-f4e577e9ded2 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:47.362746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:47.369202 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:47.374197 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f7410848-1d10-4ef7-9c70-807679edbad6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.353390 Jan 31 04:52:47.374197 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 432/874] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:47 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:47.380589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-313ee4ee-eb25-4945-a662-96daf56ecf69 req-b5c7cc0d-cc1e-48c2-aeb2-f4e577e9ded2 service nova] Creating event network-changed:1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a for instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f on hv-cinder-82660 Jan 31 04:52:47.390497 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-313ee4ee-eb25-4945-a662-96daf56ecf69 req-b5c7cc0d-cc1e-48c2-aeb2-f4e577e9ded2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074052 Jan 31 04:52:47.391149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 443/875] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:52:48.388765 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:48.389377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:48.403428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:48.403850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:48.404655 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:48.405226 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:48.596891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:48.605880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:48.607540 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:48.609258 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-07eb49c3-5133-4768-907f-03f3ee36a230 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.224668 Jan 31 04:52:48.622989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 433/876] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:48 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:49.638703 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:49.639537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:49.648517 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:49.650504 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:49.655483 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:49.656234 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:49.816874 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:49.825743 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:49.827747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:49.828969 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-dfd0c9a3-dc36-487d-9a90-14bdee1a8e15 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.194875 Jan 31 04:52:49.830075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 444/877] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:49 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:50.847467 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:50.848801 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:50.860741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:50.862642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:50.863491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:50.863934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:51.030731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:51.039085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:51.040745 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:51.041878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-08306c03-3a51-4693-9e82-8c0011e1d4f4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.198060 Jan 31 04:52:51.042433 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 434/878] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:50 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:52.060065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:52.060855 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:52.068250 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:52.068699 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:52.069476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:52.069902 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:52.215812 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:52.223821 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:52.225400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:52.227165 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f67c2f56-41c9-4816-918a-fd8fdd95e5e2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.170410 Jan 31 04:52:52.228356 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 445/879] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:52 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:53.247918 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:53.251194 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:53.295922 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:53.296782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:53.298148 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:53.298835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:53.502040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:53.512972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:53.515757 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:53.517109 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6d0c6b62-9dc8-4df2-8f07-4365c19f8c5f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.275142 Jan 31 04:52:53.517665 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 435/880] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:53 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:54.535758 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:54.536980 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:54.546255 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:54.547076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:54.548456 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:54.549712 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:54.732225 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:54.740252 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:54.741920 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:54.743049 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e99a2a9b-1e01-418a-9349-940a1e9c6673 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.211074 Jan 31 04:52:54.746279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 446/881] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:54 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:55.761300 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:55.761989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:55.768427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:55.768878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:55.769655 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:55.770093 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:55.803604 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-9c1dadb3-6582-41d0-bafc-7bb9a3ae03b7 req-93081075-5fd3-4b6e-90a1-5e0eab20127b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c83adf7-7265-467f-a4cc-1d9d0252b24f", "name": "network-vif-plugged", "status": "completed", "tag": "1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:55.806479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:52:55.806479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:52:55.824023 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-9c1dadb3-6582-41d0-bafc-7bb9a3ae03b7 req-93081075-5fd3-4b6e-90a1-5e0eab20127b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:55.825212 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-9c1dadb3-6582-41d0-bafc-7bb9a3ae03b7 req-93081075-5fd3-4b6e-90a1-5e0eab20127b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:55.839701 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-9c1dadb3-6582-41d0-bafc-7bb9a3ae03b7 req-93081075-5fd3-4b6e-90a1-5e0eab20127b service nova] Creating event network-vif-plugged:1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a for instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f on hv-cinder-82660 Jan 31 04:52:55.847790 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-9c1dadb3-6582-41d0-bafc-7bb9a3ae03b7 req-93081075-5fd3-4b6e-90a1-5e0eab20127b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046377 Jan 31 04:52:55.847790 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 447/882] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:52:55.978988 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:55.988615 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:55.990827 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:55.993062 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e29fb755-6f6d-4191-8b1a-cee763183bef tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.236638 Jan 31 04:52:55.994320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 436/883] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:55 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:57.011827 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:57.012468 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:57.018493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:57.018984 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:57.020022 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:57.020199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:57.159136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:57.168346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:57.170034 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:57.170634 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-512a5a24-b942-40e7-844d-802bb2a7ba7a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Action: 'create', calling method: .version_select at 0x7f69f4a2d4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-29663173"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:57.171341 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-50850edf-ab6a-4640-ae12-8d481aa6e03f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1408 microversion: 2.20 time: 0.163126 Jan 31 04:52:57.174689 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 437/884] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:57 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:52:57.185667 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-512a5a24-b942-40e7-844d-802bb2a7ba7a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Getting quotas for project 36c2584cb883458eaf6b3b04d55a9429. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:52:57.189442 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-512a5a24-b942-40e7-844d-802bb2a7ba7a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Getting quotas for user 3a231040d254416cb6af258aed9f9278 and project 36c2584cb883458eaf6b3b04d55a9429. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:52:57.533620 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-512a5a24-b942-40e7-844d-802bb2a7ba7a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Getting quotas for project 36c2584cb883458eaf6b3b04d55a9429. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:52:57.537480 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-512a5a24-b942-40e7-844d-802bb2a7ba7a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Getting quotas for user 3a231040d254416cb6af258aed9f9278 and project 36c2584cb883458eaf6b3b04d55a9429. Resources: {'key_pairs'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:52:57.550546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-512a5a24-b942-40e7-844d-802bb2a7ba7a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.568994 Jan 31 04:52:57.551177 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 448/885] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Jan 31 04:52:56 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:52:58.189345 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:58.189958 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:58.196738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:58.197408 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:58.198387 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:58.198842 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:58.343558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:58.353140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:58.355146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:58.356668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b5ca194e-a367-45f5-bb29-355d56a57c80 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1599 microversion: 2.20 time: 0.171115 Jan 31 04:52:58.359314 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 438/886] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:58 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:52:58.378983 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f67acb0d-8f54-4baf-8092-b9cb1e552a01 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:58.379598 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f67acb0d-8f54-4baf-8092-b9cb1e552a01 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:58.388014 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f67acb0d-8f54-4baf-8092-b9cb1e552a01 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:58.388461 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f67acb0d-8f54-4baf-8092-b9cb1e552a01 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:58.389529 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f67acb0d-8f54-4baf-8092-b9cb1e552a01 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:58.390149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f67acb0d-8f54-4baf-8092-b9cb1e552a01 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:58.505279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f67acb0d-8f54-4baf-8092-b9cb1e552a01 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.130692 Jan 31 04:52:58.510379 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 449/887] 10.222.0.21 () {60 vars in 1315 bytes} [Mon Jan 31 04:52:58 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:52:59.755395 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:52:59.756080 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:52:59.759282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-16bfeb0d-8d09-417b-a7de-fb5a89cbebb6 req-483ed21c-3aaa-470a-9ee3-a7de4ae6e594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c83adf7-7265-467f-a4cc-1d9d0252b24f", "tag": "1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:52:59.760826 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:52:59.760826 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:52:59.765340 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:59.768098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-16bfeb0d-8d09-417b-a7de-fb5a89cbebb6 req-483ed21c-3aaa-470a-9ee3-a7de4ae6e594 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:59.768661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:59.768792 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-16bfeb0d-8d09-417b-a7de-fb5a89cbebb6 req-483ed21c-3aaa-470a-9ee3-a7de4ae6e594 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:59.769555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:52:59.770069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:52:59.781457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-16bfeb0d-8d09-417b-a7de-fb5a89cbebb6 req-483ed21c-3aaa-470a-9ee3-a7de4ae6e594 service nova] Creating event network-changed:1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a for instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f on hv-cinder-82660 Jan 31 04:52:59.786643 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-16bfeb0d-8d09-417b-a7de-fb5a89cbebb6 req-483ed21c-3aaa-470a-9ee3-a7de4ae6e594 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031819 Jan 31 04:52:59.787450 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 450/888] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:52:59.930663 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:59.938779 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:59.940420 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:52:59.941565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5794a0dc-5b30-47c2-bc1c-83621910d76f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1599 microversion: 2.20 time: 0.190657 Jan 31 04:52:59.942320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 439/889] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:52:59 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1599 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:53:00.959470 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:00.960542 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:00.966947 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:00.967398 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:00.968182 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:00.968620 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:01.130935 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:01.139885 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:01.141370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:01.142539 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-fd59860d-6ff6-4dfe-b59f-18ae7d26e0dc tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1716 microversion: 2.20 time: 0.187055 Jan 31 04:53:01.143129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 451/890] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:53:00 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1716 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:53:01.160781 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6a9434a0-ae81-4438-9856-07f3f18e6e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:01.161396 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6a9434a0-ae81-4438-9856-07f3f18e6e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:01.168646 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a9434a0-ae81-4438-9856-07f3f18e6e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:01.169172 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a9434a0-ae81-4438-9856-07f3f18e6e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:01.170011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a9434a0-ae81-4438-9856-07f3f18e6e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:01.170524 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a9434a0-ae81-4438-9856-07f3f18e6e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:01.194182 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6a9434a0-ae81-4438-9856-07f3f18e6e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/ips" status: 200 len: 149 microversion: 2.20 time: 0.037282 Jan 31 04:53:01.195095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 440/891] 10.222.0.21 () {60 vars in 1288 bytes} [Mon Jan 31 04:53:01 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:53:19.622962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b4524bf3-3c33-443f-a596-e85deaebb325 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:19.624127 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b4524bf3-3c33-443f-a596-e85deaebb325 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:19.630295 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4524bf3-3c33-443f-a596-e85deaebb325 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:19.630740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4524bf3-3c33-443f-a596-e85deaebb325 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:19.631536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4524bf3-3c33-443f-a596-e85deaebb325 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:19.631968 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4524bf3-3c33-443f-a596-e85deaebb325 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:19.659763 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b4524bf3-3c33-443f-a596-e85deaebb325 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041095 Jan 31 04:53:19.660304 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 452/892] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:53:19 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 04:53:19.713309 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0891b77e-5a33-4ac2-b4e6-b3b84675f85d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:19.713830 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0891b77e-5a33-4ac2-b4e6-b3b84675f85d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:19.720638 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0891b77e-5a33-4ac2-b4e6-b3b84675f85d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:19.721110 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0891b77e-5a33-4ac2-b4e6-b3b84675f85d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:19.721767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0891b77e-5a33-4ac2-b4e6-b3b84675f85d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:19.722199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0891b77e-5a33-4ac2-b4e6-b3b84675f85d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:19.746311 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0891b77e-5a33-4ac2-b4e6-b3b84675f85d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:53:19.973935 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0891b77e-5a33-4ac2-b4e6-b3b84675f85d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 204 len: 0 microversion: 2.1 time: 0.263929 Jan 31 04:53:19.974518 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 441/893] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:53:19 2022] DELETE /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:53:19.983244 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-476c3b72-1e42-4080-a9d2-62e9a3f6ca5a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:19.983854 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-476c3b72-1e42-4080-a9d2-62e9a3f6ca5a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:19.989621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-476c3b72-1e42-4080-a9d2-62e9a3f6ca5a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:19.990068 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-476c3b72-1e42-4080-a9d2-62e9a3f6ca5a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:19.990866 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-476c3b72-1e42-4080-a9d2-62e9a3f6ca5a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:19.991305 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-476c3b72-1e42-4080-a9d2-62e9a3f6ca5a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:20.128702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-476c3b72-1e42-4080-a9d2-62e9a3f6ca5a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:20.135902 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-476c3b72-1e42-4080-a9d2-62e9a3f6ca5a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1675 microversion: 2.1 time: 0.156926 Jan 31 04:53:20.136479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 453/894] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:19 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:21.153705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-582ef9b6-ecc3-4eb2-b1c5-471050eca5f9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:21.154408 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-582ef9b6-ecc3-4eb2-b1c5-471050eca5f9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:21.160789 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-582ef9b6-ecc3-4eb2-b1c5-471050eca5f9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:21.161234 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-582ef9b6-ecc3-4eb2-b1c5-471050eca5f9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:21.162006 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-582ef9b6-ecc3-4eb2-b1c5-471050eca5f9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:21.162445 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-582ef9b6-ecc3-4eb2-b1c5-471050eca5f9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:21.297952 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-582ef9b6-ecc3-4eb2-b1c5-471050eca5f9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:21.305437 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-582ef9b6-ecc3-4eb2-b1c5-471050eca5f9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1675 microversion: 2.1 time: 0.156686 Jan 31 04:53:21.306006 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 442/895] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:21 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:22.324229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ccfa78a1-5cb2-46e7-9bbb-b66043cafebf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:22.324882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ccfa78a1-5cb2-46e7-9bbb-b66043cafebf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:22.332105 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ccfa78a1-5cb2-46e7-9bbb-b66043cafebf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:22.343783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ccfa78a1-5cb2-46e7-9bbb-b66043cafebf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:22.343783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ccfa78a1-5cb2-46e7-9bbb-b66043cafebf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:22.343783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ccfa78a1-5cb2-46e7-9bbb-b66043cafebf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:22.407746 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ccfa78a1-5cb2-46e7-9bbb-b66043cafebf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:22.414929 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ccfa78a1-5cb2-46e7-9bbb-b66043cafebf tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1608 microversion: 2.1 time: 0.095335 Jan 31 04:53:22.418418 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 454/896] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:22 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1608 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:22.882835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-3038c567-5ff0-485c-88ed-acdcdb396e70 req-0b991bcc-dd67-4bd1-9f7d-d350a686efec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b864423-6740-4f17-848e-ab7213f4ceab", "name": "network-vif-deleted", "tag": "f8fdd1ca-9af9-4dbb-9ecf-1f7188a736a6"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:22.884362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:53:22.884362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:53:22.898803 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-3038c567-5ff0-485c-88ed-acdcdb396e70 req-0b991bcc-dd67-4bd1-9f7d-d350a686efec service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:22.898803 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-3038c567-5ff0-485c-88ed-acdcdb396e70 req-0b991bcc-dd67-4bd1-9f7d-d350a686efec service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:22.904875 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-3038c567-5ff0-485c-88ed-acdcdb396e70 req-0b991bcc-dd67-4bd1-9f7d-d350a686efec service nova] Creating event network-vif-deleted:f8fdd1ca-9af9-4dbb-9ecf-1f7188a736a6 for instance 2b864423-6740-4f17-848e-ab7213f4ceab on hv-cinder-82660 Jan 31 04:53:22.909049 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-3038c567-5ff0-485c-88ed-acdcdb396e70 req-0b991bcc-dd67-4bd1-9f7d-d350a686efec service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029770 Jan 31 04:53:22.909633 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 443/897] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:22.916532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-94354200", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-29663173", "security_groups": [{"name": "tempest-secgroup-smoke-994810663"}], "networks": [{"uuid": "9dc4954d-5256-4e49-a2f8-4dd8d7f1c3c3"}], "block_device_mapping_v2": [{"uuid": "0c5c580e-bad4-4cb7-9511-f166b8712d6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:23.036204 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] validate_networks() for [('9dc4954d-5256-4e49-a2f8-4dd8d7f1c3c3', None, None, None, None, None)] {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:53:23.411311 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:53:23.416022 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:53:23.416022 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:53:23.416022 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:53:23.416022 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:53:23.422676 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:23.423181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:23.424028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:23.424466 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:23.431959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:23.432662 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:23.440017 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:23.441184 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:23.442209 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:23.442865 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:23.460591 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Getting quotas for project 36c2584cb883458eaf6b3b04d55a9429. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:53:23.465251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Getting quotas for user 3a231040d254416cb6af258aed9f9278 and project 36c2584cb883458eaf6b3b04d55a9429. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:53:23.479136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:23.479873 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:23.482433 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lazy-loading 'fault' on Instance uuid 2b864423-6740-4f17-848e-ab7213f4ceab {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:53:23.526243 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:23.528627 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:53:23.530731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c5c580e-bad4-4cb7-9511-f166b8712d6b',volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:53:23.541161 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-aca697cc-e69c-4890-be90-fdd21c4f91e9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 200 len: 1328 microversion: 2.1 time: 0.110126 Jan 31 04:53:23.541161 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 444/898] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:23 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:23.942521 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0ece536c-d67e-4acb-965a-0afb726f6785 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.029395 Jan 31 04:53:23.943608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 455/899] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:53:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:53:23.953301 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c89ba2c3-4a7e-411d-a50c-b3bfbeb2937b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:23.953921 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c89ba2c3-4a7e-411d-a50c-b3bfbeb2937b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:24.009453 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c89ba2c3-4a7e-411d-a50c-b3bfbeb2937b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:24.018363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c89ba2c3-4a7e-411d-a50c-b3bfbeb2937b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1085 microversion: 2.1 time: 0.066804 Jan 31 04:53:24.018363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 445/900] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:23 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1085 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:24.555663 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:24.556222 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:24.565723 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:24.566167 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:24.566986 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:24.567419 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:24.580986 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] HTTP exception thrown: Instance 2b864423-6740-4f17-848e-ab7213f4ceab could not be found. Jan 31 04:53:24.581572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Returning 404 to user: Instance 2b864423-6740-4f17-848e-ab7213f4ceab could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:53:24.582516 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-10bfdd47-39e1-4eb7-94d8-18efae8d986e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 404 len: 111 microversion: 2.1 time: 0.031056 Jan 31 04:53:24.583164 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 456/901] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:24 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:53:24.593458 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-31656af1-d0c1-4964-8f46-39fc67c41d25 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '.version_select at 0x7f69f52209d0>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:24.672428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-31656af1-d0c1-4964-8f46-39fc67c41d25 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444506426" status: 202 len: 0 microversion: 2.1 time: 0.084729 Jan 31 04:53:24.672990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 446/902] 10.222.0.21 () {58 vars in 1220 bytes} [Mon Jan 31 04:53:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444506426 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:53:25.033624 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7d37159c-9d96-4774-bc95-8a805cd9bf9c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:25.034271 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7d37159c-9d96-4774-bc95-8a805cd9bf9c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:25.040147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7d37159c-9d96-4774-bc95-8a805cd9bf9c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:25.040666 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7d37159c-9d96-4774-bc95-8a805cd9bf9c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:25.041537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7d37159c-9d96-4774-bc95-8a805cd9bf9c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:25.041979 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7d37159c-9d96-4774-bc95-8a805cd9bf9c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:25.107297 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7d37159c-9d96-4774-bc95-8a805cd9bf9c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:25.115364 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7d37159c-9d96-4774-bc95-8a805cd9bf9c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1135 microversion: 2.1 time: 0.085312 Jan 31 04:53:25.116007 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 457/903] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:25 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1135 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:25.452421 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-17531e5d-9ec0-48dd-b896-6341fca68fd2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'create', calling method: .version_select at 0x7f69f51fd670>, body: {"keypair": {"name": "tempest-keypair-1399137640"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:25.470713 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-17531e5d-9ec0-48dd-b896-6341fca68fd2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:53:25.474647 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-17531e5d-9ec0-48dd-b896-6341fca68fd2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for user e72e8f061290417f8b8a4bb8a0d9d2c1 and project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:53:25.802069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-17531e5d-9ec0-48dd-b896-6341fca68fd2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:53:25.805758 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-17531e5d-9ec0-48dd-b896-6341fca68fd2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for user e72e8f061290417f8b8a4bb8a0d9d2c1 and project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:53:25.818480 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-17531e5d-9ec0-48dd-b896-6341fca68fd2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.370416 Jan 31 04:53:25.819142 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 447/904] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Jan 31 04:53:25 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:26.143679 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b633d9de-c19c-45d9-aeb7-85a26c680acf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:26.144337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b633d9de-c19c-45d9-aeb7-85a26c680acf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:26.151488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b633d9de-c19c-45d9-aeb7-85a26c680acf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:26.151947 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b633d9de-c19c-45d9-aeb7-85a26c680acf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:26.154121 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b633d9de-c19c-45d9-aeb7-85a26c680acf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:26.154739 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b633d9de-c19c-45d9-aeb7-85a26c680acf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:26.226640 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b633d9de-c19c-45d9-aeb7-85a26c680acf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:26.234467 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b633d9de-c19c-45d9-aeb7-85a26c680acf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1191 microversion: 2.1 time: 0.094467 Jan 31 04:53:26.236951 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 458/905] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:26 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:27.253406 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8f9671f3-aae7-4952-9a7f-0feb3bc823b7 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:27.258879 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8f9671f3-aae7-4952-9a7f-0feb3bc823b7 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:27.261654 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f9671f3-aae7-4952-9a7f-0feb3bc823b7 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:27.262279 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f9671f3-aae7-4952-9a7f-0feb3bc823b7 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:27.263508 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f9671f3-aae7-4952-9a7f-0feb3bc823b7 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:27.264119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8f9671f3-aae7-4952-9a7f-0feb3bc823b7 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:27.459661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8f9671f3-aae7-4952-9a7f-0feb3bc823b7 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:27.468221 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8f9671f3-aae7-4952-9a7f-0feb3bc823b7 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1268 microversion: 2.1 time: 0.219896 Jan 31 04:53:27.468835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 448/906] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:27 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1268 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:27.872223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-25a50b86-5a92-45cf-940f-8bf1c0421954 req-035be61c-a816-4be3-8fe1-c906d512333a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e253ce-c129-44d9-9219-b29dd9feb759", "tag": "93af9573-d882-4ed1-ba22-f2922408b158"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:27.875266 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:53:27.875266 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:53:27.882713 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-25a50b86-5a92-45cf-940f-8bf1c0421954 req-035be61c-a816-4be3-8fe1-c906d512333a service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:27.883269 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-25a50b86-5a92-45cf-940f-8bf1c0421954 req-035be61c-a816-4be3-8fe1-c906d512333a service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:27.899036 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-25a50b86-5a92-45cf-940f-8bf1c0421954 req-035be61c-a816-4be3-8fe1-c906d512333a service nova] Creating event network-changed:93af9573-d882-4ed1-ba22-f2922408b158 for instance 42e253ce-c129-44d9-9219-b29dd9feb759 on hv-cinder-82660 Jan 31 04:53:27.904356 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-25a50b86-5a92-45cf-940f-8bf1c0421954 req-035be61c-a816-4be3-8fe1-c906d512333a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036417 Jan 31 04:53:27.905458 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 459/907] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:28.017741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-727488905", "imageRef": "93b5b8db-9cd7-4c8a-a725-b356b72428fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6d9d9c2-37a6-46fa-b349-eedfe966b621"}], "security_groups": [{"name": "tempest-securitygroup--1463140591"}], "key_name": "tempest-keypair-1399137640", "user_data": "}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:28.122498 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] validate_networks() for [('e6d9d9c2-37a6-46fa-b349-eedfe966b621', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:53:28.485764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1bef12b7-0567-4021-9463-0cc2ed2e8d55 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:28.486382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1bef12b7-0567-4021-9463-0cc2ed2e8d55 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:28.492789 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1bef12b7-0567-4021-9463-0cc2ed2e8d55 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:28.493242 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1bef12b7-0567-4021-9463-0cc2ed2e8d55 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:28.494027 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1bef12b7-0567-4021-9463-0cc2ed2e8d55 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:28.494456 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1bef12b7-0567-4021-9463-0cc2ed2e8d55 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:28.649989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:53:28.650484 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:53:28.651097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:53:28.651509 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:53:28.651919 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:53:28.661355 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:28.661806 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:28.662615 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:28.663078 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:28.680060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:53:28.683951 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Getting quotas for user e72e8f061290417f8b8a4bb8a0d9d2c1 and project 3dfe36d08de049af88fd724e90fbb0d5. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:53:28.694428 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:53:28.696749 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93b5b8db-9cd7-4c8a-a725-b356b72428fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:53:28.732117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1bef12b7-0567-4021-9463-0cc2ed2e8d55 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:28.739327 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1bef12b7-0567-4021-9463-0cc2ed2e8d55 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.257580 Jan 31 04:53:28.739833 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 460/908] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:28 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:28.792253 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0bae557f-775e-4680-9958-9d7bb4e94f92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.778598 Jan 31 04:53:28.793019 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 449/909] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:53:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:53:28.803237 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-285b3ad5-7352-402a-8993-c46b06f68439 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:28.803855 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-285b3ad5-7352-402a-8993-c46b06f68439 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:28.858453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-285b3ad5-7352-402a-8993-c46b06f68439 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:28.867552 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-285b3ad5-7352-402a-8993-c46b06f68439 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1237 microversion: 2.1 time: 0.065377 Jan 31 04:53:28.867552 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 461/910] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:28 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:29.757171 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ddf041a9-98e4-4ea1-9f0a-ce4a72aa35b2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:29.757763 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ddf041a9-98e4-4ea1-9f0a-ce4a72aa35b2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:29.764189 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ddf041a9-98e4-4ea1-9f0a-ce4a72aa35b2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:29.764629 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ddf041a9-98e4-4ea1-9f0a-ce4a72aa35b2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:29.765399 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ddf041a9-98e4-4ea1-9f0a-ce4a72aa35b2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:29.765887 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ddf041a9-98e4-4ea1-9f0a-ce4a72aa35b2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:29.881353 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-35c18ea7-7c17-475d-8342-d65deff45140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:29.882099 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-35c18ea7-7c17-475d-8342-d65deff45140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:29.888367 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-35c18ea7-7c17-475d-8342-d65deff45140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:29.889013 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-35c18ea7-7c17-475d-8342-d65deff45140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:29.889750 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-35c18ea7-7c17-475d-8342-d65deff45140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:29.890179 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-35c18ea7-7c17-475d-8342-d65deff45140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:29.908093 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ddf041a9-98e4-4ea1-9f0a-ce4a72aa35b2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:29.916484 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ddf041a9-98e4-4ea1-9f0a-ce4a72aa35b2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.163422 Jan 31 04:53:29.917044 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 450/911] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:29 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:29.954499 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-35c18ea7-7c17-475d-8342-d65deff45140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:29.961968 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-35c18ea7-7c17-475d-8342-d65deff45140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1233 microversion: 2.1 time: 0.084270 Jan 31 04:53:29.962529 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 462/912] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:29 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:30.934470 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ad90b5ec-e938-468b-928d-58bcf7a470ec tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:30.936169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ad90b5ec-e938-468b-928d-58bcf7a470ec tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:30.943093 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad90b5ec-e938-468b-928d-58bcf7a470ec tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:30.943537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad90b5ec-e938-468b-928d-58bcf7a470ec tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:30.944309 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad90b5ec-e938-468b-928d-58bcf7a470ec tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:30.944742 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad90b5ec-e938-468b-928d-58bcf7a470ec tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:30.981825 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8b45e274-1cc0-4731-b038-7bade65ee437 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:30.983394 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8b45e274-1cc0-4731-b038-7bade65ee437 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:30.991401 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b45e274-1cc0-4731-b038-7bade65ee437 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:30.992076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b45e274-1cc0-4731-b038-7bade65ee437 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:30.994075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b45e274-1cc0-4731-b038-7bade65ee437 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:30.994075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8b45e274-1cc0-4731-b038-7bade65ee437 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:31.072905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8b45e274-1cc0-4731-b038-7bade65ee437 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:31.082278 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8b45e274-1cc0-4731-b038-7bade65ee437 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1295 microversion: 2.1 time: 0.105113 Jan 31 04:53:31.085197 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 463/913] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:30 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:31.091532 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ad90b5ec-e938-468b-928d-58bcf7a470ec tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:31.100376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ad90b5ec-e938-468b-928d-58bcf7a470ec tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.169574 Jan 31 04:53:31.100992 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 451/914] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:30 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:32.104080 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-58020c35-3eab-47c0-ac2f-f81c10da56d9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:32.104693 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-58020c35-3eab-47c0-ac2f-f81c10da56d9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:32.110959 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-58020c35-3eab-47c0-ac2f-f81c10da56d9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:32.111405 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-58020c35-3eab-47c0-ac2f-f81c10da56d9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:32.112182 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-58020c35-3eab-47c0-ac2f-f81c10da56d9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:32.112614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-58020c35-3eab-47c0-ac2f-f81c10da56d9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:32.121394 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a6695bf2-eaf7-4cb3-bbc9-0bd74ac90db5 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:32.121989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a6695bf2-eaf7-4cb3-bbc9-0bd74ac90db5 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:32.128297 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6695bf2-eaf7-4cb3-bbc9-0bd74ac90db5 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:32.128738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6695bf2-eaf7-4cb3-bbc9-0bd74ac90db5 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:32.129502 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6695bf2-eaf7-4cb3-bbc9-0bd74ac90db5 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:32.129931 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a6695bf2-eaf7-4cb3-bbc9-0bd74ac90db5 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:32.277902 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a6695bf2-eaf7-4cb3-bbc9-0bd74ac90db5 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:32.288076 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a6695bf2-eaf7-4cb3-bbc9-0bd74ac90db5 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.170369 Jan 31 04:53:32.299174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 452/915] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:32 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:32.304587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-d443299e-9228-442c-a7d8-9b3f1aaa333e req-d238ba7c-0638-41b3-986c-ee7033facfb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7564c77-f2d4-468d-9bc2-d5ab564cad98", "tag": "4af2afed-e9f7-4915-bc66-556a64225bb5"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:32.306376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:53:32.306376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:53:32.314878 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-d443299e-9228-442c-a7d8-9b3f1aaa333e req-d238ba7c-0638-41b3-986c-ee7033facfb6 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:32.315603 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-d443299e-9228-442c-a7d8-9b3f1aaa333e req-d238ba7c-0638-41b3-986c-ee7033facfb6 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:32.323325 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-58020c35-3eab-47c0-ac2f-f81c10da56d9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:32.331810 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-58020c35-3eab-47c0-ac2f-f81c10da56d9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.230999 Jan 31 04:53:32.334195 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-d443299e-9228-442c-a7d8-9b3f1aaa333e req-d238ba7c-0638-41b3-986c-ee7033facfb6 service nova] Creating event network-changed:4af2afed-e9f7-4915-bc66-556a64225bb5 for instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 on hv-cinder-82660 Jan 31 04:53:32.339540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 464/916] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:32 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:32.344392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-d443299e-9228-442c-a7d8-9b3f1aaa333e req-d238ba7c-0638-41b3-986c-ee7033facfb6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043613 Jan 31 04:53:32.345279 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 453/917] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:33.305316 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b81d9018-7fd0-4d23-8218-9630339c23fe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:33.305925 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b81d9018-7fd0-4d23-8218-9630339c23fe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:33.312898 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b81d9018-7fd0-4d23-8218-9630339c23fe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:33.317083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b81d9018-7fd0-4d23-8218-9630339c23fe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:33.317083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b81d9018-7fd0-4d23-8218-9630339c23fe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:33.317083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b81d9018-7fd0-4d23-8218-9630339c23fe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:33.350364 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a25a4312-e6e7-4a94-962c-5be0d4474eee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:33.351114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a25a4312-e6e7-4a94-962c-5be0d4474eee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:33.357521 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a25a4312-e6e7-4a94-962c-5be0d4474eee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:33.358022 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a25a4312-e6e7-4a94-962c-5be0d4474eee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:33.358825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a25a4312-e6e7-4a94-962c-5be0d4474eee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:33.359267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a25a4312-e6e7-4a94-962c-5be0d4474eee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:33.454064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b81d9018-7fd0-4d23-8218-9630339c23fe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:33.461467 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b81d9018-7fd0-4d23-8218-9630339c23fe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.159772 Jan 31 04:53:33.462050 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 465/918] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:33 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:33.494501 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a25a4312-e6e7-4a94-962c-5be0d4474eee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:33.502291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a25a4312-e6e7-4a94-962c-5be0d4474eee tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.156395 Jan 31 04:53:33.502905 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 454/919] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:33 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:34.478061 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-378b6653-f9dc-4097-b6d3-83f3273f8cc0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:34.478675 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-378b6653-f9dc-4097-b6d3-83f3273f8cc0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:34.485583 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-378b6653-f9dc-4097-b6d3-83f3273f8cc0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:34.486031 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-378b6653-f9dc-4097-b6d3-83f3273f8cc0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:34.486827 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-378b6653-f9dc-4097-b6d3-83f3273f8cc0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:34.487277 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-378b6653-f9dc-4097-b6d3-83f3273f8cc0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:34.518851 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-56352d23-a3f4-4dbd-b331-f4e5f58b5537 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:34.519579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-56352d23-a3f4-4dbd-b331-f4e5f58b5537 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:34.525926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-56352d23-a3f4-4dbd-b331-f4e5f58b5537 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:34.526595 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-56352d23-a3f4-4dbd-b331-f4e5f58b5537 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:34.527414 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-56352d23-a3f4-4dbd-b331-f4e5f58b5537 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:34.527854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-56352d23-a3f4-4dbd-b331-f4e5f58b5537 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:34.625248 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-378b6653-f9dc-4097-b6d3-83f3273f8cc0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:34.632528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-378b6653-f9dc-4097-b6d3-83f3273f8cc0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.157988 Jan 31 04:53:34.633089 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 466/920] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:34 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:34.665757 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-56352d23-a3f4-4dbd-b331-f4e5f58b5537 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:34.673476 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-56352d23-a3f4-4dbd-b331-f4e5f58b5537 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.158261 Jan 31 04:53:34.674029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 455/921] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:34 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:35.650054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e5455108-8514-4e30-9f31-255fd68489ff tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:35.650660 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e5455108-8514-4e30-9f31-255fd68489ff tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:35.657024 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e5455108-8514-4e30-9f31-255fd68489ff tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:35.657466 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e5455108-8514-4e30-9f31-255fd68489ff tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:35.658234 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e5455108-8514-4e30-9f31-255fd68489ff tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:35.658672 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e5455108-8514-4e30-9f31-255fd68489ff tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:35.689729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-47994aff-748e-4cd8-bc8f-42206d5caa9e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:35.690434 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-47994aff-748e-4cd8-bc8f-42206d5caa9e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:35.696900 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47994aff-748e-4cd8-bc8f-42206d5caa9e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:35.697345 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47994aff-748e-4cd8-bc8f-42206d5caa9e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:35.698159 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47994aff-748e-4cd8-bc8f-42206d5caa9e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:35.698589 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47994aff-748e-4cd8-bc8f-42206d5caa9e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:35.793501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e5455108-8514-4e30-9f31-255fd68489ff tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:35.801642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e5455108-8514-4e30-9f31-255fd68489ff tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.155183 Jan 31 04:53:35.802171 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 467/922] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:35 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:35.829729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-47994aff-748e-4cd8-bc8f-42206d5caa9e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:35.836751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-47994aff-748e-4cd8-bc8f-42206d5caa9e tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.150701 Jan 31 04:53:35.837289 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 456/923] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:35 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:36.818981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-694b365a-9c86-4f1d-831f-3d34104dcb46 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:36.819592 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-694b365a-9c86-4f1d-831f-3d34104dcb46 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:36.825750 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-694b365a-9c86-4f1d-831f-3d34104dcb46 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:36.826188 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-694b365a-9c86-4f1d-831f-3d34104dcb46 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:36.826992 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-694b365a-9c86-4f1d-831f-3d34104dcb46 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:36.827417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-694b365a-9c86-4f1d-831f-3d34104dcb46 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:36.853109 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9aec56e2-f6d3-42e7-adc7-41f5c499176f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:36.853726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9aec56e2-f6d3-42e7-adc7-41f5c499176f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:36.860959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9aec56e2-f6d3-42e7-adc7-41f5c499176f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:36.861419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9aec56e2-f6d3-42e7-adc7-41f5c499176f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:36.862203 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9aec56e2-f6d3-42e7-adc7-41f5c499176f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:36.862741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9aec56e2-f6d3-42e7-adc7-41f5c499176f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:36.965282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-694b365a-9c86-4f1d-831f-3d34104dcb46 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:36.973026 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-694b365a-9c86-4f1d-831f-3d34104dcb46 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.157949 Jan 31 04:53:36.973585 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 468/924] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:36 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:37.002264 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9aec56e2-f6d3-42e7-adc7-41f5c499176f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:37.009584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9aec56e2-f6d3-42e7-adc7-41f5c499176f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.160093 Jan 31 04:53:37.010141 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 457/925] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:36 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:37.990024 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7b29cee6-6a7f-4e91-ba8c-7f8f78595534 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:37.990543 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7b29cee6-6a7f-4e91-ba8c-7f8f78595534 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:37.996774 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7b29cee6-6a7f-4e91-ba8c-7f8f78595534 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:37.997351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7b29cee6-6a7f-4e91-ba8c-7f8f78595534 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:37.998127 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7b29cee6-6a7f-4e91-ba8c-7f8f78595534 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:37.998836 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7b29cee6-6a7f-4e91-ba8c-7f8f78595534 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:38.026831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-232f5aa1-008c-4dfe-b533-126c97a5ec61 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:38.028149 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-232f5aa1-008c-4dfe-b533-126c97a5ec61 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:38.035173 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-232f5aa1-008c-4dfe-b533-126c97a5ec61 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:38.035618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-232f5aa1-008c-4dfe-b533-126c97a5ec61 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:38.036389 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-232f5aa1-008c-4dfe-b533-126c97a5ec61 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:38.036811 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-232f5aa1-008c-4dfe-b533-126c97a5ec61 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:38.135504 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7b29cee6-6a7f-4e91-ba8c-7f8f78595534 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:38.143379 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7b29cee6-6a7f-4e91-ba8c-7f8f78595534 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.157065 Jan 31 04:53:38.144083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 469/926] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:37 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:38.172806 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-232f5aa1-008c-4dfe-b533-126c97a5ec61 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:38.179836 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-232f5aa1-008c-4dfe-b533-126c97a5ec61 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.156540 Jan 31 04:53:38.180379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 458/927] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:38 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:39.160346 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7e75c205-430a-453c-8108-5f3cd707053e tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:39.161088 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7e75c205-430a-453c-8108-5f3cd707053e tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:39.167206 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7e75c205-430a-453c-8108-5f3cd707053e tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:39.167647 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7e75c205-430a-453c-8108-5f3cd707053e tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:39.168422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7e75c205-430a-453c-8108-5f3cd707053e tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:39.168820 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7e75c205-430a-453c-8108-5f3cd707053e tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:39.196329 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ad46613d-6a54-46be-b5e0-b78face03a64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:39.197008 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ad46613d-6a54-46be-b5e0-b78face03a64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:39.203849 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad46613d-6a54-46be-b5e0-b78face03a64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:39.204296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad46613d-6a54-46be-b5e0-b78face03a64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:39.205080 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad46613d-6a54-46be-b5e0-b78face03a64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:39.205512 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ad46613d-6a54-46be-b5e0-b78face03a64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:39.336005 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ad46613d-6a54-46be-b5e0-b78face03a64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:39.344080 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ad46613d-6a54-46be-b5e0-b78face03a64 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.151284 Jan 31 04:53:39.344658 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 459/928] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:39 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:39.374034 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7e75c205-430a-453c-8108-5f3cd707053e tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:39.381556 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7e75c205-430a-453c-8108-5f3cd707053e tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.224597 Jan 31 04:53:39.382121 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 470/929] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:39 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:40.360936 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c8b0206d-56d8-400e-9114-f444720a4523 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:40.361482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c8b0206d-56d8-400e-9114-f444720a4523 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:40.367708 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c8b0206d-56d8-400e-9114-f444720a4523 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:40.368144 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c8b0206d-56d8-400e-9114-f444720a4523 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:40.369109 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c8b0206d-56d8-400e-9114-f444720a4523 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:40.369546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c8b0206d-56d8-400e-9114-f444720a4523 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:40.397131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-49849b90-f925-4487-83c3-19940a09f50f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:40.397744 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-49849b90-f925-4487-83c3-19940a09f50f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:40.404101 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-49849b90-f925-4487-83c3-19940a09f50f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:40.404595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-49849b90-f925-4487-83c3-19940a09f50f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:40.405462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-49849b90-f925-4487-83c3-19940a09f50f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:40.405896 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-49849b90-f925-4487-83c3-19940a09f50f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:40.503871 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c8b0206d-56d8-400e-9114-f444720a4523 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:40.511023 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c8b0206d-56d8-400e-9114-f444720a4523 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.154546 Jan 31 04:53:40.511778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 460/930] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:40 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:40.538857 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-49849b90-f925-4487-83c3-19940a09f50f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:40.546712 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-49849b90-f925-4487-83c3-19940a09f50f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.152975 Jan 31 04:53:40.547298 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 471/931] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:40 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:41.360739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-a707dd64-567e-41e3-b007-b69b365910a0 req-b5b1c76e-581b-4a9c-b1df-a97883d813ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7564c77-f2d4-468d-9bc2-d5ab564cad98", "name": "network-vif-plugged", "status": "completed", "tag": "4af2afed-e9f7-4915-bc66-556a64225bb5"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:41.362309 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:53:41.362309 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:53:41.369534 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-a707dd64-567e-41e3-b007-b69b365910a0 req-b5b1c76e-581b-4a9c-b1df-a97883d813ec service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:41.369975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-a707dd64-567e-41e3-b007-b69b365910a0 req-b5b1c76e-581b-4a9c-b1df-a97883d813ec service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:41.380679 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-a707dd64-567e-41e3-b007-b69b365910a0 req-b5b1c76e-581b-4a9c-b1df-a97883d813ec service nova] Creating event network-vif-plugged:4af2afed-e9f7-4915-bc66-556a64225bb5 for instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 on hv-cinder-82660 Jan 31 04:53:41.385616 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-a707dd64-567e-41e3-b007-b69b365910a0 req-b5b1c76e-581b-4a9c-b1df-a97883d813ec service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029126 Jan 31 04:53:41.386182 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 461/932] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:41.527580 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f25a7b93-dfb6-4fa2-aa4e-a3684741a08d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:41.528312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f25a7b93-dfb6-4fa2-aa4e-a3684741a08d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:41.535216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f25a7b93-dfb6-4fa2-aa4e-a3684741a08d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:41.535733 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f25a7b93-dfb6-4fa2-aa4e-a3684741a08d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:41.536647 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f25a7b93-dfb6-4fa2-aa4e-a3684741a08d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:41.537129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f25a7b93-dfb6-4fa2-aa4e-a3684741a08d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:41.563806 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4872bc2a-fdbb-4431-95a7-b1896c05e8d2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:41.564642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4872bc2a-fdbb-4431-95a7-b1896c05e8d2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:41.571007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4872bc2a-fdbb-4431-95a7-b1896c05e8d2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:41.571449 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4872bc2a-fdbb-4431-95a7-b1896c05e8d2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:41.572231 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4872bc2a-fdbb-4431-95a7-b1896c05e8d2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:41.572663 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4872bc2a-fdbb-4431-95a7-b1896c05e8d2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:41.676377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f25a7b93-dfb6-4fa2-aa4e-a3684741a08d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:41.686452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f25a7b93-dfb6-4fa2-aa4e-a3684741a08d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.162331 Jan 31 04:53:41.688112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 472/933] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:41 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:41.721577 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4872bc2a-fdbb-4431-95a7-b1896c05e8d2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:41.730476 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4872bc2a-fdbb-4431-95a7-b1896c05e8d2 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.170536 Jan 31 04:53:41.731418 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 462/934] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:41 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:42.703628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-45c7b339-f25f-4111-a946-e163af01f158 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:42.704254 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-45c7b339-f25f-4111-a946-e163af01f158 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:42.710487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-45c7b339-f25f-4111-a946-e163af01f158 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:42.710963 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-45c7b339-f25f-4111-a946-e163af01f158 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:42.711731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-45c7b339-f25f-4111-a946-e163af01f158 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:42.712162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-45c7b339-f25f-4111-a946-e163af01f158 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:42.747192 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e648cf1a-dc27-4cba-ab31-3f54e4c096dd tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:42.747790 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e648cf1a-dc27-4cba-ab31-3f54e4c096dd tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:42.755249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e648cf1a-dc27-4cba-ab31-3f54e4c096dd tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:42.755690 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e648cf1a-dc27-4cba-ab31-3f54e4c096dd tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:42.756474 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e648cf1a-dc27-4cba-ab31-3f54e4c096dd tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:42.756901 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e648cf1a-dc27-4cba-ab31-3f54e4c096dd tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:42.843595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-45c7b339-f25f-4111-a946-e163af01f158 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:42.851510 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-45c7b339-f25f-4111-a946-e163af01f158 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1363 microversion: 2.1 time: 0.151651 Jan 31 04:53:42.852080 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 473/935] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:42 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:42.893197 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e648cf1a-dc27-4cba-ab31-3f54e4c096dd tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:42.900337 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e648cf1a-dc27-4cba-ab31-3f54e4c096dd tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.156675 Jan 31 04:53:42.900925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 463/936] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:42 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:43.399900 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-e6bd5c7e-aa08-4e21-b1cf-4330406bad62 req-43c9a146-2273-4396-aadc-193653b3f1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e253ce-c129-44d9-9219-b29dd9feb759", "name": "network-vif-plugged", "status": "completed", "tag": "93af9573-d882-4ed1-ba22-f2922408b158"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:43.403932 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:53:43.403932 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:53:43.410212 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-e6bd5c7e-aa08-4e21-b1cf-4330406bad62 req-43c9a146-2273-4396-aadc-193653b3f1e8 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:43.410651 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-e6bd5c7e-aa08-4e21-b1cf-4330406bad62 req-43c9a146-2273-4396-aadc-193653b3f1e8 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:43.423166 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-e6bd5c7e-aa08-4e21-b1cf-4330406bad62 req-43c9a146-2273-4396-aadc-193653b3f1e8 service nova] Creating event network-vif-plugged:93af9573-d882-4ed1-ba22-f2922408b158 for instance 42e253ce-c129-44d9-9219-b29dd9feb759 on hv-cinder-82660 Jan 31 04:53:43.427952 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-e6bd5c7e-aa08-4e21-b1cf-4330406bad62 req-43c9a146-2273-4396-aadc-193653b3f1e8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031746 Jan 31 04:53:43.428519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 474/937] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:43.868183 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-85d4ad9e-954e-4596-9ab9-bcad508e3ed7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:43.868860 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-85d4ad9e-954e-4596-9ab9-bcad508e3ed7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:43.876249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-85d4ad9e-954e-4596-9ab9-bcad508e3ed7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:43.876710 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-85d4ad9e-954e-4596-9ab9-bcad508e3ed7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:43.877492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-85d4ad9e-954e-4596-9ab9-bcad508e3ed7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:43.877924 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-85d4ad9e-954e-4596-9ab9-bcad508e3ed7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:43.918152 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e1160f57-5f24-4d0f-9a0b-6fbb9012ddbe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:43.919361 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e1160f57-5f24-4d0f-9a0b-6fbb9012ddbe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:43.925980 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e1160f57-5f24-4d0f-9a0b-6fbb9012ddbe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:43.926509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e1160f57-5f24-4d0f-9a0b-6fbb9012ddbe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:43.927422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e1160f57-5f24-4d0f-9a0b-6fbb9012ddbe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:43.927934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e1160f57-5f24-4d0f-9a0b-6fbb9012ddbe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:44.032059 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-85d4ad9e-954e-4596-9ab9-bcad508e3ed7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:44.039913 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-85d4ad9e-954e-4596-9ab9-bcad508e3ed7 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1549 microversion: 2.1 time: 0.175386 Jan 31 04:53:44.051410 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 464/938] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:43 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:44.058308 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0cfeaab4-169a-44b8-ba5a-27a0c6dd522d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:44.058823 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0cfeaab4-169a-44b8-ba5a-27a0c6dd522d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:44.066075 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cfeaab4-169a-44b8-ba5a-27a0c6dd522d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:44.066535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cfeaab4-169a-44b8-ba5a-27a0c6dd522d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:44.067885 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cfeaab4-169a-44b8-ba5a-27a0c6dd522d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:44.068332 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0cfeaab4-169a-44b8-ba5a-27a0c6dd522d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:44.084417 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e1160f57-5f24-4d0f-9a0b-6fbb9012ddbe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:44.096047 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e1160f57-5f24-4d0f-9a0b-6fbb9012ddbe tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.181328 Jan 31 04:53:44.096965 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 475/939] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:43 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:44.156292 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0cfeaab4-169a-44b8-ba5a-27a0c6dd522d tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102362 Jan 31 04:53:44.157025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 465/940] 10.222.0.21 () {58 vars in 1274 bytes} [Mon Jan 31 04:53:44 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:53:45.112989 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a8b6e1ad-e7b4-41e4-a52e-9d7be2ad8929 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:45.113530 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a8b6e1ad-e7b4-41e4-a52e-9d7be2ad8929 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:45.119924 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8b6e1ad-e7b4-41e4-a52e-9d7be2ad8929 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:45.120370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8b6e1ad-e7b4-41e4-a52e-9d7be2ad8929 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:45.121150 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8b6e1ad-e7b4-41e4-a52e-9d7be2ad8929 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:45.121586 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a8b6e1ad-e7b4-41e4-a52e-9d7be2ad8929 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:45.258382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a8b6e1ad-e7b4-41e4-a52e-9d7be2ad8929 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:45.265882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a8b6e1ad-e7b4-41e4-a52e-9d7be2ad8929 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1256 microversion: 2.1 time: 0.156641 Jan 31 04:53:45.266453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 476/941] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:45 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1256 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:45.357478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1d6663db-e603-4698-b6da-3186cb81c120 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:45.358706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1d6663db-e603-4698-b6da-3186cb81c120 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:45.361792 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-ff391957-4ee4-4d31-bc07-56a05b88d280 req-5a43b503-40ff-48cf-898d-0e10d3db6ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7564c77-f2d4-468d-9bc2-d5ab564cad98", "tag": "4af2afed-e9f7-4915-bc66-556a64225bb5"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:45.363771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:53:45.363771 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:53:45.365882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1d6663db-e603-4698-b6da-3186cb81c120 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:45.366457 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1d6663db-e603-4698-b6da-3186cb81c120 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:45.367390 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1d6663db-e603-4698-b6da-3186cb81c120 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:45.367923 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1d6663db-e603-4698-b6da-3186cb81c120 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:45.370911 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ff391957-4ee4-4d31-bc07-56a05b88d280 req-5a43b503-40ff-48cf-898d-0e10d3db6ae7 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:45.383137 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ff391957-4ee4-4d31-bc07-56a05b88d280 req-5a43b503-40ff-48cf-898d-0e10d3db6ae7 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:45.394947 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-ff391957-4ee4-4d31-bc07-56a05b88d280 req-5a43b503-40ff-48cf-898d-0e10d3db6ae7 service nova] Creating event network-changed:4af2afed-e9f7-4915-bc66-556a64225bb5 for instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 on hv-cinder-82660 Jan 31 04:53:45.400043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-ff391957-4ee4-4d31-bc07-56a05b88d280 req-5a43b503-40ff-48cf-898d-0e10d3db6ae7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043776 Jan 31 04:53:45.404882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 477/942] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:45.527977 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1d6663db-e603-4698-b6da-3186cb81c120 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:45.535719 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1d6663db-e603-4698-b6da-3186cb81c120 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1549 microversion: 2.1 time: 0.182232 Jan 31 04:53:45.538938 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 466/943] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:45 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1549 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:46.283351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-778e521f-12bd-4c6a-bd9c-605833605846 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:46.284070 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-778e521f-12bd-4c6a-bd9c-605833605846 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:46.290914 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-778e521f-12bd-4c6a-bd9c-605833605846 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:46.291309 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-778e521f-12bd-4c6a-bd9c-605833605846 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:46.292076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-778e521f-12bd-4c6a-bd9c-605833605846 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:46.292522 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-778e521f-12bd-4c6a-bd9c-605833605846 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:46.438426 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-778e521f-12bd-4c6a-bd9c-605833605846 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:46.446504 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-778e521f-12bd-4c6a-bd9c-605833605846 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1440 microversion: 2.1 time: 0.167599 Jan 31 04:53:46.447245 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 478/944] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:46 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1440 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:46.462531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f37aff97-a4d8-4c43-96b7-68ce0f1c4488 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:46.463240 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f37aff97-a4d8-4c43-96b7-68ce0f1c4488 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:46.470219 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f37aff97-a4d8-4c43-96b7-68ce0f1c4488 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:46.470744 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f37aff97-a4d8-4c43-96b7-68ce0f1c4488 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:46.471613 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f37aff97-a4d8-4c43-96b7-68ce0f1c4488 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:46.472112 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f37aff97-a4d8-4c43-96b7-68ce0f1c4488 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:46.552888 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-74d5a7ae-a9d6-41c1-b532-6e2f31511d1f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:46.553936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-74d5a7ae-a9d6-41c1-b532-6e2f31511d1f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:46.559907 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74d5a7ae-a9d6-41c1-b532-6e2f31511d1f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:46.560556 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74d5a7ae-a9d6-41c1-b532-6e2f31511d1f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:46.561864 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74d5a7ae-a9d6-41c1-b532-6e2f31511d1f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:46.562471 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-74d5a7ae-a9d6-41c1-b532-6e2f31511d1f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:46.609844 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f37aff97-a4d8-4c43-96b7-68ce0f1c4488 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:46.617169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f37aff97-a4d8-4c43-96b7-68ce0f1c4488 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1440 microversion: 2.1 time: 0.158231 Jan 31 04:53:46.622449 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 467/945] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:46 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1440 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:53:46.698909 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-74d5a7ae-a9d6-41c1-b532-6e2f31511d1f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:53:46.708432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-74d5a7ae-a9d6-41c1-b532-6e2f31511d1f tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1668 microversion: 2.1 time: 0.157593 Jan 31 04:53:46.708432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 479/946] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:53:46 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:53:46.722960 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1581791f-416b-482b-8597-658e2d18fa92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:46.723591 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1581791f-416b-482b-8597-658e2d18fa92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:46.735676 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1581791f-416b-482b-8597-658e2d18fa92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:46.736126 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1581791f-416b-482b-8597-658e2d18fa92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:46.736909 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1581791f-416b-482b-8597-658e2d18fa92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:46.737344 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1581791f-416b-482b-8597-658e2d18fa92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:46.760849 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1581791f-416b-482b-8597-658e2d18fa92 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/ips" status: 200 len: 146 microversion: 2.1 time: 0.041574 Jan 31 04:53:46.761413 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 468/947] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Jan 31 04:53:46 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:48.612267 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-f94ea3ad-7a36-4cc8-bd36-abe4fb2b16e9 req-9e6e1bf6-2fb5-4f48-87d9-5e6304682979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e253ce-c129-44d9-9219-b29dd9feb759", "tag": "93af9573-d882-4ed1-ba22-f2922408b158"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:48.613939 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:53:48.613939 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:53:48.621242 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-f94ea3ad-7a36-4cc8-bd36-abe4fb2b16e9 req-9e6e1bf6-2fb5-4f48-87d9-5e6304682979 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:48.621674 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-f94ea3ad-7a36-4cc8-bd36-abe4fb2b16e9 req-9e6e1bf6-2fb5-4f48-87d9-5e6304682979 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:48.633123 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-f94ea3ad-7a36-4cc8-bd36-abe4fb2b16e9 req-9e6e1bf6-2fb5-4f48-87d9-5e6304682979 service nova] Creating event network-changed:93af9573-d882-4ed1-ba22-f2922408b158 for instance 42e253ce-c129-44d9-9219-b29dd9feb759 on hv-cinder-82660 Jan 31 04:53:48.638200 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-f94ea3ad-7a36-4cc8-bd36-abe4fb2b16e9 req-9e6e1bf6-2fb5-4f48-87d9-5e6304682979 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029436 Jan 31 04:53:48.638785 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 480/948] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:49.391650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-774b7206-229e-4ff7-8d82-c8d3eed707ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85b76ced-ac57-4442-a5e5-352d9c43a107"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:49.392989 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-774b7206-229e-4ff7-8d82-c8d3eed707ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:49.399323 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-774b7206-229e-4ff7-8d82-c8d3eed707ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:49.399770 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-774b7206-229e-4ff7-8d82-c8d3eed707ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:49.400552 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-774b7206-229e-4ff7-8d82-c8d3eed707ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:49.400988 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-774b7206-229e-4ff7-8d82-c8d3eed707ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:49.977310 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-774b7206-229e-4ff7-8d82-c8d3eed707ce tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598446 Jan 31 04:53:49.977954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 469/949] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:53:49 2022] POST /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments => generated 194 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:57.434640 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-76f2ea02-932e-4b89-bb4f-242c8ed54d35 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:57.435753 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-76f2ea02-932e-4b89-bb4f-242c8ed54d35 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:57.442715 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-76f2ea02-932e-4b89-bb4f-242c8ed54d35 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:57.443191 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-76f2ea02-932e-4b89-bb4f-242c8ed54d35 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:57.443960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-76f2ea02-932e-4b89-bb4f-242c8ed54d35 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:57.444394 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-76f2ea02-932e-4b89-bb4f-242c8ed54d35 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:57.475192 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-76f2ea02-932e-4b89-bb4f-242c8ed54d35 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Jan 31 04:53:57.475731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 481/950] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:53:57 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:57.487280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-edc0468d-7481-4d5f-be73-88f660f81bb9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:53:57.487903 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-edc0468d-7481-4d5f-be73-88f660f81bb9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:57.493955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-edc0468d-7481-4d5f-be73-88f660f81bb9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:57.494395 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-edc0468d-7481-4d5f-be73-88f660f81bb9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:57.495202 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-edc0468d-7481-4d5f-be73-88f660f81bb9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:57.495635 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-edc0468d-7481-4d5f-be73-88f660f81bb9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:57.525594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-edc0468d-7481-4d5f-be73-88f660f81bb9 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/85b76ced-ac57-4442-a5e5-352d9c43a107" status: 200 len: 194 microversion: 2.1 time: 0.043252 Jan 31 04:53:57.526182 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 470/951] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Jan 31 04:53:57 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/85b76ced-ac57-4442-a5e5-352d9c43a107 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:53:59.068802 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ebd7af56-1f3f-453e-8351-3fdeaad8e6b2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "163b61d2-60e7-4763-af9d-17cbe339bd65"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:53:59.069836 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ebd7af56-1f3f-453e-8351-3fdeaad8e6b2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:53:59.075544 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ebd7af56-1f3f-453e-8351-3fdeaad8e6b2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:59.076396 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ebd7af56-1f3f-453e-8351-3fdeaad8e6b2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:59.076789 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ebd7af56-1f3f-453e-8351-3fdeaad8e6b2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:53:59.077218 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ebd7af56-1f3f-453e-8351-3fdeaad8e6b2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:53:59.863731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ebd7af56-1f3f-453e-8351-3fdeaad8e6b2 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "POST /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798637 Jan 31 04:53:59.864256 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 482/952] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:53:59 2022] POST /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:54:08.378162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b3c182e8-bb88-45f9-90da-22712b225b83 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:08.379154 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b3c182e8-bb88-45f9-90da-22712b225b83 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:08.385492 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3c182e8-bb88-45f9-90da-22712b225b83 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:08.385936 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3c182e8-bb88-45f9-90da-22712b225b83 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:08.386694 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3c182e8-bb88-45f9-90da-22712b225b83 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:08.387220 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b3c182e8-bb88-45f9-90da-22712b225b83 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:08.420975 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b3c182e8-bb88-45f9-90da-22712b225b83 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047078 Jan 31 04:54:08.421508 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 471/953] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:54:08 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:54:17.649500 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c3d035a5-4922-460a-b507-5383a2d2ce9a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:54:17.650179 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c3d035a5-4922-460a-b507-5383a2d2ce9a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:17.657002 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c3d035a5-4922-460a-b507-5383a2d2ce9a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:17.657441 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c3d035a5-4922-460a-b507-5383a2d2ce9a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:17.658209 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c3d035a5-4922-460a-b507-5383a2d2ce9a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:17.658636 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c3d035a5-4922-460a-b507-5383a2d2ce9a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:17.681277 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-c3d035a5-4922-460a-b507-5383a2d2ce9a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lazy-loading 'flavor' on Instance uuid 1c83adf7-7265-467f-a4cc-1d9d0252b24f {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:54:18.126410 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c3d035a5-4922-460a-b507-5383a2d2ce9a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/action" status: 202 len: 0 microversion: 2.20 time: 0.480770 Jan 31 04:54:18.127052 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 483/954] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Jan 31 04:54:17 2022] POST /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:54:18.140143 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:18.140757 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:18.147108 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:18.147587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:18.148404 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:18.148839 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:18.282246 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:18.289962 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:18.291501 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:18.292682 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3b433e18-e86b-4a91-8850-6ec2abddba3b tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.156279 Jan 31 04:54:18.293238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 472/955] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:18 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:19.313432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:19.314084 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:19.320175 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:19.320646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:19.321410 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:19.321840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:19.453228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:19.460921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:19.462440 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:19.463605 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-32e7e970-81bf-437b-8853-86ed0a2490a1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.155293 Jan 31 04:54:19.464152 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 484/956] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:19 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:20.481741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:20.482344 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:20.489190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:20.489634 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:20.490393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:20.490843 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:20.619145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:20.627604 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:20.629084 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:20.630220 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3e6c1e2b-338e-4c13-b099-6f61e77cc733 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.152173 Jan 31 04:54:20.630765 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 473/957] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:20 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:21.647844 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:21.648445 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:21.654647 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:21.655112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:21.655926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:21.656351 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:21.790694 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:21.799955 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:21.801438 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:21.802617 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-648cfa00-4c87-4974-b266-50e1f5d39d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.158446 Jan 31 04:54:21.803195 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 485/958] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:21 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:22.821192 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:22.821798 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:22.829036 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:22.829482 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:22.830253 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:22.830685 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:22.964489 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:22.972222 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:22.973713 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:22.974902 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4b1a2a7f-aacd-43d8-81d1-368017c0a857 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.157439 Jan 31 04:54:22.975463 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 474/959] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:22 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:23.992234 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:23.992841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:23.999888 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:24.000602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:24.001710 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:24.002138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:24.134453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:24.143390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:24.144856 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:24.145985 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b1612138-bb69-4caf-acaf-c21393f7d58d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.157432 Jan 31 04:54:24.146526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 486/960] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:23 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:25.164052 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:25.164656 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:25.170745 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:25.171311 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:25.172117 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:25.172546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:25.306287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:25.314504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:25.316005 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:25.317147 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-da3c6c9a-2b16-487e-acb5-f17f0866b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.156808 Jan 31 04:54:25.317702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 475/961] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:25 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:26.334760 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:26.335394 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:26.341687 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:26.342133 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:26.343993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:26.344444 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:26.477758 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:26.485302 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:26.486761 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:26.487911 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-63bf6dd2-a50a-4176-8269-0103841abaee tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.157076 Jan 31 04:54:26.488459 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 487/962] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:26 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:27.505393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:27.507694 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:27.512253 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:27.512703 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:27.513478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:27.513917 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:27.648846 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:27.657018 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:27.658517 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:27.659701 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-92c58ac6-87bf-4ea8-9344-964ea1c51fcf tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.157994 Jan 31 04:54:27.660255 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 476/963] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:27 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:28.677770 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:28.678312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:28.684481 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:28.684922 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:28.685688 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:28.686124 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:28.817548 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:28.825065 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:28.826528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:28.828236 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cb58806b-cda0-4320-91fc-31f65d7bce38 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.154310 Jan 31 04:54:28.828783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 488/964] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:28 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:54:29.845831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:29.846462 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:29.852636 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:29.853079 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:29.853895 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:29.854333 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:29.984374 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:29.992043 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:29.993533 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:29.994680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f8971a1c-8400-45cf-84df-bb3ee4076833 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.153246 Jan 31 04:54:29.995259 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 477/965] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:29 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:31.012876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:31.013482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:31.019764 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:31.020213 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:31.020988 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:31.021423 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:31.154146 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:31.164962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:31.166426 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:31.167671 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6e0f051d-15e5-4a5a-b897-f4a2fedb019c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.158500 Jan 31 04:54:31.168754 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 489/966] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:31 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:32.190839 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:32.191443 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:32.197315 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:32.197756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:32.198512 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:32.198979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:32.332346 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:32.339995 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:32.341433 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:32.342580 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-980beecd-dce7-4a33-addb-72f98b9d9503 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.155876 Jan 31 04:54:32.343343 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 478/967] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:32 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:33.360793 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:33.361331 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:33.367447 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:33.368864 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:33.368864 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:33.369075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:33.504064 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:33.511595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:33.513058 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:33.514194 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8d9cfd02-16ec-49dd-88ae-8ce395f99744 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.157245 Jan 31 04:54:33.515379 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 490/968] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:33 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:34.533365 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:34.533960 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:34.540116 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:34.540551 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:34.541307 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:34.541734 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:34.675285 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:34.683091 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:34.684610 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:34.685812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9e21fce7-3066-4b9f-8fe3-c27fd6d08824 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.156675 Jan 31 04:54:34.686425 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 479/969] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:34 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:54:35.704802 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:35.705414 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:35.711668 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:35.712109 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:35.712876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:35.713306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:35.845249 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:35.852876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:35.854354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:35.855554 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1ea457e9-3318-4e6d-8405-e70f0c381cbd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1743 microversion: 2.20 time: 0.155603 Jan 31 04:54:35.856103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 491/970] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:35 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:36.873595 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:36.874883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:36.880811 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:36.881256 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:36.882021 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:36.882452 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:37.012939 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:37.021500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:37.023031 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:37.024176 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1fb62d83-da6c-4c6d-9de3-9d77af57b12e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1743 microversion: 2.20 time: 0.154487 Jan 31 04:54:37.024733 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 480/971] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:36 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:38.042401 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:38.043072 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:38.049838 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:38.050285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:38.051138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:38.051526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:38.185334 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:38.192190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:38.193707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:38.194865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f730b938-69f2-4e48-a3ee-98ce70248f26 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1743 microversion: 2.20 time: 0.156199 Jan 31 04:54:38.195409 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 492/972] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:38 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:39.212472 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:39.213068 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:39.219317 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:39.219758 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:39.220526 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:39.220955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:39.358682 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:39.366542 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:39.368156 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:39.369317 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cf6d60bf-b552-4e28-874b-ba493b30a9da tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1743 microversion: 2.20 time: 0.160493 Jan 31 04:54:39.369880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 481/973] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:39 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:39.675374 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-6d775103-b4a3-40b5-8b9c-d3e7b21cb3e8 req-9e14d630-6633-40c4-8fbe-8a5b986c8db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c83adf7-7265-467f-a4cc-1d9d0252b24f", "name": "network-vif-plugged", "status": "completed", "tag": "1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:54:39.677106 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:54:39.677106 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:54:39.684628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-6d775103-b4a3-40b5-8b9c-d3e7b21cb3e8 req-9e14d630-6633-40c4-8fbe-8a5b986c8db0 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:39.685076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-6d775103-b4a3-40b5-8b9c-d3e7b21cb3e8 req-9e14d630-6633-40c4-8fbe-8a5b986c8db0 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:39.699143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-6d775103-b4a3-40b5-8b9c-d3e7b21cb3e8 req-9e14d630-6633-40c4-8fbe-8a5b986c8db0 service nova] Creating event network-vif-plugged:1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a for instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f on hv-cinder-82660 Jan 31 04:54:39.705190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-6d775103-b4a3-40b5-8b9c-d3e7b21cb3e8 req-9e14d630-6633-40c4-8fbe-8a5b986c8db0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034411 Jan 31 04:54:39.705881 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 493/974] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:54:40.388074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:40.388639 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:40.395094 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:40.395547 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:40.396321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:40.396758 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:40.524439 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:40.533002 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:40.534512 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:40.535720 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-30dc4399-e6a4-4601-8aca-dfa009a882a6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1743 microversion: 2.20 time: 0.151415 Jan 31 04:54:40.536281 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 482/975] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:40 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:41.555719 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:41.556403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:41.563098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:41.563540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:41.564300 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:41.564730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:41.695878 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:41.704833 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:41.706337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:41.707547 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-57f30055-589e-4783-a57c-862aba929e39 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1743 microversion: 2.20 time: 0.156334 Jan 31 04:54:41.708101 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 494/976] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:41 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:42.725223 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:42.726176 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:42.732731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:42.734594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:42.735420 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:42.735854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:42.882162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:42.891892 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:42.893702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:42.895251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d7ea8dae-8493-41fc-bdb9-43d02ad7e71f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.173715 Jan 31 04:54:42.896009 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 483/977] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:42 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:43.914691 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:43.915952 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:43.923416 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:43.923947 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:43.924897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:43.925327 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:44.094689 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:44.104887 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:44.106399 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:44.109081 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0484a8c7-65c4-4cc6-bda7-bb032898e3b2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.198209 Jan 31 04:54:44.109637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 495/978] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:43 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:45.130576 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:45.131431 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:45.138517 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:45.143092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:45.143092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:45.143092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:45.300267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:45.310339 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:45.312363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:45.313660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2b7c53e4-8f80-4091-99c4-87a28078b7a7 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.187186 Jan 31 04:54:45.314208 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 484/979] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:45 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:46.331428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:46.332675 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:46.340459 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:46.340907 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:46.341681 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:46.342246 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:46.487672 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:46.495991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:46.497913 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:46.499947 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cbf19aa9-0ef1-46db-b61f-1f5790a02523 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.172211 Jan 31 04:54:46.502863 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 496/980] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:46 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:47.518041 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:47.519300 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:47.527565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:47.528173 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:47.529092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:47.529667 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:47.678888 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:47.687835 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:47.689770 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:47.691201 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ac6b39d2-017e-4f89-b09d-ceba2bb987ab tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.177639 Jan 31 04:54:47.692449 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 485/981] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:47 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:48.711706 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:48.712320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:48.718639 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:48.719106 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:48.719879 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:48.720307 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:48.858705 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:48.866822 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:48.869602 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:48.870783 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3b859612-ef5c-405a-a6a0-5bb655a4bf54 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.162970 Jan 31 04:54:48.871539 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 497/982] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:48 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:49.889597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:49.890263 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:49.896930 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:49.897381 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:49.898160 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:49.898603 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:50.038314 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:50.046376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:50.048572 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:50.049732 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d88043e0-238b-4a34-a84b-0f92f8a7b10e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.164485 Jan 31 04:54:50.050286 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 486/983] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:49 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:51.068384 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:51.069062 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:51.075515 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:51.076235 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:51.078003 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:51.079072 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:51.232865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:51.241676 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:51.243229 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:51.244379 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e3f4056f-9d2f-4a02-9633-bad39ac245e6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.179710 Jan 31 04:54:51.245146 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 498/984] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:51 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:52.262993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:52.263571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:52.270735 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:52.271215 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:52.271981 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:52.272414 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:52.416378 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:52.425249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:52.426735 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:52.427908 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9c28bdad-8558-4ca9-bc30-8160aa3dd44f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.168657 Jan 31 04:54:52.428674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 487/985] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:52 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:53.446167 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:53.446781 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:53.456198 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:53.456652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:53.457437 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:53.457874 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:53.600807 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:53.610034 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:53.611572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:53.612748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-841a2d20-4be4-44c3-b32f-736f94487944 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.170316 Jan 31 04:54:53.613289 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 499/986] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:53 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:54.630863 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:54.631465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:54.637738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:54.638186 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:54.638976 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:54.639407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:54.772594 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:54.780259 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:54.782392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:54.783628 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-59247256-05f7-4bba-bfed-f763882ae97a tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1738 microversion: 2.20 time: 0.157291 Jan 31 04:54:54.784178 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 488/987] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:54 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:55.802398 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:55.803037 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:55.809193 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:55.809641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:55.810406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:55.810872 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:55.945104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:55.952644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:55.954893 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:55.956043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f0fa8253-f350-40d8-83ea-10d707bbc6f6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1720 microversion: 2.20 time: 0.158462 Jan 31 04:54:55.956600 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 500/988] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:55 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:56.973831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:56.974453 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:56.980614 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:56.981052 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:56.981972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:56.982225 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:57.114571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:57.122666 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:57.124340 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:57.126271 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4b01c8ca-5ff4-4f53-8ea5-21a5de55556d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1720 microversion: 2.20 time: 0.156146 Jan 31 04:54:57.127016 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 489/989] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:56 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:57.755415 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-60f9490b-396d-439a-931c-c325959fd0ef req-8b522c63-a9ab-4f7d-b210-df958157215b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c83adf7-7265-467f-a4cc-1d9d0252b24f", "name": "network-vif-unplugged", "status": "completed", "tag": "1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:54:57.757551 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:54:57.757551 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:54:57.764327 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-60f9490b-396d-439a-931c-c325959fd0ef req-8b522c63-a9ab-4f7d-b210-df958157215b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:57.764762 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-60f9490b-396d-439a-931c-c325959fd0ef req-8b522c63-a9ab-4f7d-b210-df958157215b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:57.776509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-60f9490b-396d-439a-931c-c325959fd0ef req-8b522c63-a9ab-4f7d-b210-df958157215b service nova] Creating event network-vif-unplugged:1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a for instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f on hv-cinder-82660 Jan 31 04:54:57.781306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-60f9490b-396d-439a-931c-c325959fd0ef req-8b522c63-a9ab-4f7d-b210-df958157215b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029693 Jan 31 04:54:57.785050 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 501/990] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:54:58.144782 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:58.145354 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:58.151668 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:58.152113 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:58.152879 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:58.153330 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:58.285238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:58.292901 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:58.294393 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:54:58.295574 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6cb09a93-aa5d-4f13-aea3-834cb8d9a542 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1663 microversion: 2.20 time: 0.154982 Jan 31 04:54:58.296132 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 490/991] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:54:58 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:54:58.314181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-96cb3053-bc7a-48d3-84d0-780f5249d6d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03cb9f50-e4b5-4dc8-b164-70ea392e5677"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:54:58.315357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-96cb3053-bc7a-48d3-84d0-780f5249d6d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:58.321318 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96cb3053-bc7a-48d3-84d0-780f5249d6d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:58.321767 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96cb3053-bc7a-48d3-84d0-780f5249d6d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:58.322537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96cb3053-bc7a-48d3-84d0-780f5249d6d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:58.322998 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-96cb3053-bc7a-48d3-84d0-780f5249d6d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:59.190482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-96cb3053-bc7a-48d3-84d0-780f5249d6d2 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.880885 Jan 31 04:54:59.191138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 502/992] 10.222.0.21 () {62 vars in 1363 bytes} [Mon Jan 31 04:54:58 2022] POST /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/os-volume_attachments => generated 188 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 04:54:59.296565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3fe48378-3101-4727-b422-5c1bb56dd217 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:54:59.297057 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3fe48378-3101-4727-b422-5c1bb56dd217 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:59.303671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fe48378-3101-4727-b422-5c1bb56dd217 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:59.304109 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fe48378-3101-4727-b422-5c1bb56dd217 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:59.304864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fe48378-3101-4727-b422-5c1bb56dd217 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:59.305291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3fe48378-3101-4727-b422-5c1bb56dd217 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:59.840692 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3fe48378-3101-4727-b422-5c1bb56dd217 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/os-volume_attachments/03cb9f50-e4b5-4dc8-b164-70ea392e5677" status: 202 len: 0 microversion: 2.20 time: 0.547656 Jan 31 04:54:59.841209 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 491/993] 10.222.0.21 () {60 vars in 1456 bytes} [Mon Jan 31 04:54:59 2022] DELETE /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/os-volume_attachments/03cb9f50-e4b5-4dc8-b164-70ea392e5677 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:54:59.895279 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-36bcf782-7004-4185-a756-d36131e01cf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:54:59.895893 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-36bcf782-7004-4185-a756-d36131e01cf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:54:59.902884 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36bcf782-7004-4185-a756-d36131e01cf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:59.903330 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36bcf782-7004-4185-a756-d36131e01cf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:54:59.904099 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36bcf782-7004-4185-a756-d36131e01cf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:54:59.904533 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-36bcf782-7004-4185-a756-d36131e01cf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:00.123294 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-36bcf782-7004-4185-a756-d36131e01cf0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "POST /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/action" status: 202 len: 0 microversion: 2.20 time: 0.232254 Jan 31 04:55:00.124181 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 503/994] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Jan 31 04:54:59 2022] POST /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:55:00.132762 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:00.133370 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:00.139295 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:00.139780 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:00.140554 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:00.141731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:00.528846 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:00.537630 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:00.539134 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:00.540311 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9c84419b-aa44-4883-85aa-34b6b535e164 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1671 microversion: 2.20 time: 0.411356 Jan 31 04:55:00.540866 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 492/995] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:00 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1671 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:01.557740 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:01.558350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:01.564321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:01.564763 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:01.565532 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:01.565963 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:01.696016 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:01.703795 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:01.705301 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:01.706458 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c2572b9a-0eab-4b84-9ae7-c4a9536054ce tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.152945 Jan 31 04:55:01.707044 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 504/996] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:01 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:02.724601 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:02.725205 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:02.731117 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:02.731563 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:02.732337 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:02.732815 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:02.872156 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:02.882045 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:02.883585 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:02.884749 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-46244fc9-312f-4992-9600-c17da2103ff5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.163914 Jan 31 04:55:02.885509 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 493/997] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:02 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:03.902747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:03.903365 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:03.909976 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:03.910412 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:03.911270 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:03.911685 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:04.061843 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:04.071448 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:04.072936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:04.074076 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-38711e04-9d84-4341-877c-86d2195af24e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.175112 Jan 31 04:55:04.074619 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 505/998] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:03 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:05.092852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:05.093541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:05.101390 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:05.102187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:05.103220 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:05.103883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:05.246162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:05.255136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:05.256609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:05.257813 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c99b3b50-11ef-45bd-8438-a9cafe50f000 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.168905 Jan 31 04:55:05.258579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 494/999] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:05 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:05.853091 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b6b31506-2aff-42e1-9f7a-d69ba9bf9995 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:05.853621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b6b31506-2aff-42e1-9f7a-d69ba9bf9995 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:05.860849 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6b31506-2aff-42e1-9f7a-d69ba9bf9995 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:05.861797 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6b31506-2aff-42e1-9f7a-d69ba9bf9995 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:05.862986 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6b31506-2aff-42e1-9f7a-d69ba9bf9995 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:05.863731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b6b31506-2aff-42e1-9f7a-d69ba9bf9995 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:05.899380 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b6b31506-2aff-42e1-9f7a-d69ba9bf9995 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/85b76ced-ac57-4442-a5e5-352d9c43a107" status: 200 len: 194 microversion: 2.1 time: 0.049995 Jan 31 04:55:05.900666 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 506/1000] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Jan 31 04:55:05 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/85b76ced-ac57-4442-a5e5-352d9c43a107 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:55:05.910297 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-49a955b2-8d94-4138-8c90-45a0b2fb62ad tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:05.910823 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-49a955b2-8d94-4138-8c90-45a0b2fb62ad tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:05.916680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49a955b2-8d94-4138-8c90-45a0b2fb62ad tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:05.917133 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49a955b2-8d94-4138-8c90-45a0b2fb62ad tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:05.917902 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49a955b2-8d94-4138-8c90-45a0b2fb62ad tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:05.918335 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49a955b2-8d94-4138-8c90-45a0b2fb62ad tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:05.998459 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-49a955b2-8d94-4138-8c90-45a0b2fb62ad tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lazy-loading 'services' on Instance uuid c7564c77-f2d4-468d-9bc2-d5ab564cad98 {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:55:06.242758 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-49a955b2-8d94-4138-8c90-45a0b2fb62ad tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/85b76ced-ac57-4442-a5e5-352d9c43a107" status: 202 len: 0 microversion: 2.1 time: 0.336596 Jan 31 04:55:06.254218 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 495/1001] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:55:05 2022] DELETE /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/85b76ced-ac57-4442-a5e5-352d9c43a107 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:55:06.276173 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:06.277138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:06.285506 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:06.286266 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:06.287661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:06.288353 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:06.444563 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:06.452029 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:06.454048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:06.455244 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0a09cee4-abf5-41de-9385-11d4bb128b2d tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.182781 Jan 31 04:55:06.458828 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 507/1002] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:06 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:07.475155 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:07.475853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:07.481971 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:07.482416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:07.483219 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:07.483656 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:07.623985 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:07.633000 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:07.634476 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:07.635695 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3d5a221d-b35e-4b61-989d-66085ecab3f5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.165137 Jan 31 04:55:07.636211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 496/1003] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:07 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:08.654715 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:08.655286 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:08.662207 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:08.662653 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:08.663473 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:08.663906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:08.863392 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:08.871472 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:08.873380 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:08.874381 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-539e2081-85cf-46dd-a85e-915bca96cac8 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.223500 Jan 31 04:55:08.879979 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 508/1004] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:08 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:09.892246 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:09.893033 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:09.899952 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:09.900469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:09.901379 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:09.901864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:10.043883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:10.053730 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:10.055254 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:10.056609 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-47336dd6-f5a7-48c4-b368-0db51f03f365 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.168571 Jan 31 04:55:10.062254 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 497/1005] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:09 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:55:11.073398 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:11.074108 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:11.080828 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:11.081283 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:11.082075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:11.082509 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:11.230119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:11.238627 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:11.240190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:11.241354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c2e6be0e-4655-4a34-ae71-e93ed40479a0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.171680 Jan 31 04:55:11.241909 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 509/1006] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:11 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:12.260322 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:12.260932 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:12.267996 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:12.268442 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:12.269217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:12.269650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:12.399792 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:12.408227 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:12.409723 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:12.410906 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8465e354-5af3-4831-967c-b2d7cf9b9a50 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.154264 Jan 31 04:55:12.411466 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 498/1007] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:12 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:13.429196 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:13.429762 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:13.435912 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:13.436350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:13.437109 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:13.437535 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:13.571440 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:13.579046 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:13.581094 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:13.582241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3bda0bd9-0145-4d32-a5d8-c6d2b4c89f62 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.156936 Jan 31 04:55:13.582952 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 510/1008] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:13 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:14.599832 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:14.600429 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:14.606734 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:14.607208 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:14.607979 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:14.608414 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:14.746624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:14.754100 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:14.755608 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:14.756742 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6a817bb3-b8ec-4dce-b7d4-9031f3d614b1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.161205 Jan 31 04:55:14.757288 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 499/1009] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:14 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:15.775139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:15.775742 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:15.782000 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:15.782526 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:15.783458 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:15.783889 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:15.919449 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:15.928305 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:15.929798 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:15.931024 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f9f6876e-a05d-4594-9c8d-970c0d79d2d0 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.159590 Jan 31 04:55:15.931569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 511/1010] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:15 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:16.832561 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-d8c687a5-b5e4-4e82-b768-05353ebe95dc tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:16.833035 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-d8c687a5-b5e4-4e82-b768-05353ebe95dc tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:16.839212 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8c687a5-b5e4-4e82-b768-05353ebe95dc tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:16.839662 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8c687a5-b5e4-4e82-b768-05353ebe95dc tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:16.840427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8c687a5-b5e4-4e82-b768-05353ebe95dc tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:16.840860 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-d8c687a5-b5e4-4e82-b768-05353ebe95dc tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:16.868710 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-d8c687a5-b5e4-4e82-b768-05353ebe95dc tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/163b61d2-60e7-4763-af9d-17cbe339bd65" status: 200 len: 194 microversion: 2.1 time: 0.040684 Jan 31 04:55:16.869263 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 500/1011] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Jan 31 04:55:16 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/163b61d2-60e7-4763-af9d-17cbe339bd65 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:55:16.878917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8d60f209-110f-498c-bdf9-5865087ed63c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:16.879394 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8d60f209-110f-498c-bdf9-5865087ed63c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:16.885519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8d60f209-110f-498c-bdf9-5865087ed63c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:16.885962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8d60f209-110f-498c-bdf9-5865087ed63c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:16.886730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8d60f209-110f-498c-bdf9-5865087ed63c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:16.887183 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8d60f209-110f-498c-bdf9-5865087ed63c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:16.949195 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:16.950015 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:16.956429 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:16.956901 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:16.957648 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:16.958077 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:16.963857 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-8d60f209-110f-498c-bdf9-5865087ed63c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lazy-loading 'services' on Instance uuid c7564c77-f2d4-468d-9bc2-d5ab564cad98 {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:55:17.089332 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:17.097691 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:17.099236 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:17.100390 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-468412cc-7633-4464-a823-d91a2fcf7c65 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.154960 Jan 31 04:55:17.100960 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 501/1012] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:16 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:55:17.137707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8d60f209-110f-498c-bdf9-5865087ed63c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/163b61d2-60e7-4763-af9d-17cbe339bd65" status: 202 len: 0 microversion: 2.1 time: 0.262492 Jan 31 04:55:17.138290 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 512/1013] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 04:55:16 2022] DELETE /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments/163b61d2-60e7-4763-af9d-17cbe339bd65 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:55:18.118929 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:18.119541 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:18.126455 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.130778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.130778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.130778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.268848 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:18.276994 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:18.279825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:18.279825 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-aa4a0647-d89c-4943-8790-213c6feb69a4 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.164532 Jan 31 04:55:18.281061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 502/1014] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:18 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:18.298475 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-955fd85c-cb75-40e5-8d80-8a922c4dd140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:18.299550 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-955fd85c-cb75-40e5-8d80-8a922c4dd140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:18.305467 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-955fd85c-cb75-40e5-8d80-8a922c4dd140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.305912 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-955fd85c-cb75-40e5-8d80-8a922c4dd140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.306680 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-955fd85c-cb75-40e5-8d80-8a922c4dd140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.307205 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-955fd85c-cb75-40e5-8d80-8a922c4dd140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.336095 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-955fd85c-cb75-40e5-8d80-8a922c4dd140 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042240 Jan 31 04:55:18.336629 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 513/1015] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:55:18 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 31 04:55:18.437181 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-06822cd7-0146-411a-889d-237f7dda5376 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:18.438163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-06822cd7-0146-411a-889d-237f7dda5376 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:18.444556 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06822cd7-0146-411a-889d-237f7dda5376 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.444999 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06822cd7-0146-411a-889d-237f7dda5376 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.445767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06822cd7-0146-411a-889d-237f7dda5376 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.446196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06822cd7-0146-411a-889d-237f7dda5376 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.474479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-06822cd7-0146-411a-889d-237f7dda5376 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040904 Jan 31 04:55:18.475057 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 503/1016] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 04:55:18 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 04:55:18.530757 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5cf2b2ed-6ee7-4741-bf04-d8225989efb8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:18.531265 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5cf2b2ed-6ee7-4741-bf04-d8225989efb8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:18.537016 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5cf2b2ed-6ee7-4741-bf04-d8225989efb8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.537456 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5cf2b2ed-6ee7-4741-bf04-d8225989efb8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.538225 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5cf2b2ed-6ee7-4741-bf04-d8225989efb8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.538657 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5cf2b2ed-6ee7-4741-bf04-d8225989efb8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.562897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5cf2b2ed-6ee7-4741-bf04-d8225989efb8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:55:18.863992 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5cf2b2ed-6ee7-4741-bf04-d8225989efb8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 204 len: 0 microversion: 2.1 time: 0.336473 Jan 31 04:55:18.864497 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 514/1017] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:55:18 2022] DELETE /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:55:18.872724 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-586e0e52-1b6d-47a8-88ec-8359196f7c03 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:18.880403 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-586e0e52-1b6d-47a8-88ec-8359196f7c03 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:18.880403 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-586e0e52-1b6d-47a8-88ec-8359196f7c03 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.880675 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-586e0e52-1b6d-47a8-88ec-8359196f7c03 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:18.881239 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-586e0e52-1b6d-47a8-88ec-8359196f7c03 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:18.881679 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-586e0e52-1b6d-47a8-88ec-8359196f7c03 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:19.009581 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-586e0e52-1b6d-47a8-88ec-8359196f7c03 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:19.016840 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-586e0e52-1b6d-47a8-88ec-8359196f7c03 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1674 microversion: 2.1 time: 0.147890 Jan 31 04:55:19.017544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 504/1018] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:55:18 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:55:19.299422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:19.300109 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:19.306217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:19.306661 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:19.307449 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:19.307876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:19.439928 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:19.447641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:19.449123 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:19.450259 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-120594c1-85b1-44c9-8b24-c1ac0a8f42e5 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.155114 Jan 31 04:55:19.450814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 515/1019] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:19 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:19.946043 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-0a0e2d14-77ff-48b0-b873-bea25b51ad8b req-c219aff1-e328-4ccf-88aa-aafb212cf63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c83adf7-7265-467f-a4cc-1d9d0252b24f", "name": "network-vif-plugged", "status": "completed", "tag": "1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:55:19.947651 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:55:19.947651 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:55:19.955913 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-0a0e2d14-77ff-48b0-b873-bea25b51ad8b req-c219aff1-e328-4ccf-88aa-aafb212cf63d service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:19.956363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-0a0e2d14-77ff-48b0-b873-bea25b51ad8b req-c219aff1-e328-4ccf-88aa-aafb212cf63d service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:19.967382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-0a0e2d14-77ff-48b0-b873-bea25b51ad8b req-c219aff1-e328-4ccf-88aa-aafb212cf63d service nova] Creating event network-vif-plugged:1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a for instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f on hv-cinder-82660 Jan 31 04:55:19.972986 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-0a0e2d14-77ff-48b0-b873-bea25b51ad8b req-c219aff1-e328-4ccf-88aa-aafb212cf63d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030598 Jan 31 04:55:19.973555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 505/1020] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:55:20.035007 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d6b2279b-6559-4d85-9264-20918aad3efb tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:20.035624 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d6b2279b-6559-4d85-9264-20918aad3efb tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:20.041599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d6b2279b-6559-4d85-9264-20918aad3efb tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:20.041991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d6b2279b-6559-4d85-9264-20918aad3efb tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:20.043633 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d6b2279b-6559-4d85-9264-20918aad3efb tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:20.044091 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d6b2279b-6559-4d85-9264-20918aad3efb tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:20.186490 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d6b2279b-6559-4d85-9264-20918aad3efb tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:20.193737 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d6b2279b-6559-4d85-9264-20918aad3efb tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1674 microversion: 2.1 time: 0.164160 Jan 31 04:55:20.194273 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 516/1021] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:55:20 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:55:20.468376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:20.469069 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:20.475473 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:20.475915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:20.476681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:20.477108 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:20.612184 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:20.619891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:20.621376 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:20.622781 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1870c715-aa33-4d0b-8b39-05d02d9d2d27 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.158438 Jan 31 04:55:20.623362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 506/1022] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:20 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:21.210378 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0cf5d04a-17e7-41f6-94fb-999d022d50b1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:21.211018 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0cf5d04a-17e7-41f6-94fb-999d022d50b1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:21.217201 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0cf5d04a-17e7-41f6-94fb-999d022d50b1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:21.217652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0cf5d04a-17e7-41f6-94fb-999d022d50b1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:21.218424 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0cf5d04a-17e7-41f6-94fb-999d022d50b1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:21.218888 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0cf5d04a-17e7-41f6-94fb-999d022d50b1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:21.354148 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0cf5d04a-17e7-41f6-94fb-999d022d50b1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:21.362156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0cf5d04a-17e7-41f6-94fb-999d022d50b1 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1674 microversion: 2.1 time: 0.155439 Jan 31 04:55:21.362714 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 517/1023] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:55:21 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:55:21.641283 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:21.642060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:21.648138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:21.648584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:21.649358 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:21.649793 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:21.782573 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:21.788962 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:21.790448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:21.791712 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ec199a23-5fd1-4b0d-8c51-dab470a8b43f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.154199 Jan 31 04:55:21.792344 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 507/1024] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:21 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:22.380448 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-69b0fa7c-f33b-440d-9424-0e115e135a0c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:22.381069 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-69b0fa7c-f33b-440d-9424-0e115e135a0c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:22.387470 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69b0fa7c-f33b-440d-9424-0e115e135a0c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:22.388335 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69b0fa7c-f33b-440d-9424-0e115e135a0c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:22.389131 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69b0fa7c-f33b-440d-9424-0e115e135a0c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:22.389569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69b0fa7c-f33b-440d-9424-0e115e135a0c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:22.443804 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-6669fbb2-937d-4ae5-b539-1b317e3c53e7 req-8d268299-46ab-408e-9758-55ba349b1ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7564c77-f2d4-468d-9bc2-d5ab564cad98", "name": "network-vif-deleted", "tag": "4af2afed-e9f7-4915-bc66-556a64225bb5"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:55:22.445330 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:55:22.445330 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:55:22.456543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-6669fbb2-937d-4ae5-b539-1b317e3c53e7 req-8d268299-46ab-408e-9758-55ba349b1ebc service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:22.456987 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-6669fbb2-937d-4ae5-b539-1b317e3c53e7 req-8d268299-46ab-408e-9758-55ba349b1ebc service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:22.465491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-69b0fa7c-f33b-440d-9424-0e115e135a0c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e72e8f061290417f8b8a4bb8a0d9d2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfe36d08de049af88fd724e90fbb0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:22.469546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-6669fbb2-937d-4ae5-b539-1b317e3c53e7 req-8d268299-46ab-408e-9758-55ba349b1ebc service nova] Creating event network-vif-deleted:4af2afed-e9f7-4915-bc66-556a64225bb5 for instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 on hv-cinder-82660 Jan 31 04:55:22.476816 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-6669fbb2-937d-4ae5-b539-1b317e3c53e7 req-8d268299-46ab-408e-9758-55ba349b1ebc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037422 Jan 31 04:55:22.477480 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 508/1025] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:55:22.479264 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-69b0fa7c-f33b-440d-9424-0e115e135a0c tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 200 len: 1606 microversion: 2.1 time: 0.101856 Jan 31 04:55:22.480212 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 518/1026] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:55:22 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 1606 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:55:22.810369 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:22.811090 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:22.818212 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:22.818688 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:22.819513 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:22.819968 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:22.957068 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:22.965284 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:22.966771 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:22.967954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ba0045e4-1af8-4c0a-8376-53f071681647 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1729 microversion: 2.20 time: 0.162186 Jan 31 04:55:22.971354 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 509/1027] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:22 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:23.496451 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:23.497293 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:23.504186 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:23.504639 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:23.505412 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:23.505847 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:23.519611 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] HTTP exception thrown: Instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 could not be found. Jan 31 04:55:23.520482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Returning 404 to user: Instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:55:23.521097 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5f3093ac-f79c-4295-8ad1-5a1b466efb52 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 404 len: 111 microversion: 2.1 time: 0.028386 Jan 31 04:55:23.521630 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 519/1028] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:55:23 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:55:23.530032 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-eee50a19-fb80-4154-9fda-a1873563e448 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '.version_select at 0x7f69f525f820>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:23.617927 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-eee50a19-fb80-4154-9fda-a1873563e448 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399137640" status: 202 len: 0 microversion: 2.1 time: 0.091555 Jan 31 04:55:23.618509 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 510/1029] 10.222.0.21 () {58 vars in 1220 bytes} [Mon Jan 31 04:55:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399137640 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:55:23.987053 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:23.987657 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:23.993431 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:23.993879 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:23.994663 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:23.995128 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:24.493014 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:24.500849 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:24.502345 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:55:24.503527 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ea506e78-0d8c-4591-b738-18f0838b078f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1716 microversion: 2.20 time: 0.520844 Jan 31 04:55:24.504080 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 520/1030] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:55:23 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1716 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 04:55:27.204202 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:27.204838 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:27.211251 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:27.211696 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:27.212460 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:27.212892 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:27.225631 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] HTTP exception thrown: Instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 could not be found. Jan 31 04:55:27.226205 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Returning 404 to user: Instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:55:27.227039 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2259e91e-c0ef-446e-a047-50f9ad260fd8 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 404 len: 111 microversion: 2.1 time: 0.026951 Jan 31 04:55:27.227548 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 511/1031] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:55:27 2022] DELETE /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 04:55:27.235345 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:27.236452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: c7564c77-f2d4-468d-9bc2-d5ab564cad98] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:27.242724 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:27.243202 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:27.243970 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:27.244403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:27.258321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] HTTP exception thrown: Instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 could not be found. Jan 31 04:55:27.258929 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Returning 404 to user: Instance c7564c77-f2d4-468d-9bc2-d5ab564cad98 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:55:27.259728 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2dc4d8fa-6757-49df-acc0-037191e45e8a tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98" status: 404 len: 111 microversion: 2.1 time: 0.028016 Jan 31 04:55:27.260237 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 521/1032] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:55:27 2022] GET /compute/v2.1/servers/c7564c77-f2d4-468d-9bc2-d5ab564cad98 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:55:28.495955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:28.505537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:28.505537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:28.505537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:28.505537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:28.505916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:28.518289 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] HTTP exception thrown: Instance 2b864423-6740-4f17-848e-ab7213f4ceab could not be found. Jan 31 04:55:28.518881 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Returning 404 to user: Instance 2b864423-6740-4f17-848e-ab7213f4ceab could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:55:28.519680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a5da55e9-9a76-473b-8bf3-647de4073b89 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 404 len: 111 microversion: 2.1 time: 0.027380 Jan 31 04:55:28.520190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 512/1033] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:55:28 2022] DELETE /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:55:28.529276 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:55:28.529276 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] [instance: 2b864423-6740-4f17-848e-ab7213f4ceab] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:55:28.534484 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:28.534967 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:28.535791 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:55:28.536253 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:55:28.549127 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] HTTP exception thrown: Instance 2b864423-6740-4f17-848e-ab7213f4ceab could not be found. Jan 31 04:55:28.549700 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] Returning 404 to user: Instance 2b864423-6740-4f17-848e-ab7213f4ceab could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:55:28.550501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ce3b13cf-5e2d-409f-b8d5-ba5dff6ea8c6 tempest-AttachVolumeTestJSON-784820902 tempest-AttachVolumeTestJSON-784820902-project] 10.222.0.21 "GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab" status: 404 len: 111 microversion: 2.1 time: 0.026286 Jan 31 04:55:28.551043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 522/1034] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:55:28 2022] GET /compute/v2.1/servers/2b864423-6740-4f17-848e-ab7213f4ceab => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:55:32.956383 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 04:55:32.957367 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 04:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 04:56:07.229916 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f42bf537-08bb-44d1-a0aa-030cfd22abba tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:56:07.230477 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f42bf537-08bb-44d1-a0aa-030cfd22abba tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:07.236199 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f42bf537-08bb-44d1-a0aa-030cfd22abba tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:07.236640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f42bf537-08bb-44d1-a0aa-030cfd22abba tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:07.237913 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f42bf537-08bb-44d1-a0aa-030cfd22abba tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:07.238528 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f42bf537-08bb-44d1-a0aa-030cfd22abba tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:07.261074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-f42bf537-08bb-44d1-a0aa-030cfd22abba tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lazy-loading 'flavor' on Instance uuid 42e253ce-c129-44d9-9219-b29dd9feb759 {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:56:07.488119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f42bf537-08bb-44d1-a0aa-030cfd22abba tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "POST /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759/action" status: 202 len: 0 microversion: 2.1 time: 0.261155 Jan 31 04:56:07.488684 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 513/1035] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:56:07 2022] POST /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:56:07.497298 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e788eb5e-633d-40e6-9d55-b9d3692fe7f3 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:07.497907 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e788eb5e-633d-40e6-9d55-b9d3692fe7f3 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:07.504510 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e788eb5e-633d-40e6-9d55-b9d3692fe7f3 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:07.505041 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e788eb5e-633d-40e6-9d55-b9d3692fe7f3 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:07.505975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e788eb5e-633d-40e6-9d55-b9d3692fe7f3 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:07.506251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e788eb5e-633d-40e6-9d55-b9d3692fe7f3 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:07.640650 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e788eb5e-633d-40e6-9d55-b9d3692fe7f3 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:07.648207 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e788eb5e-633d-40e6-9d55-b9d3692fe7f3 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.155040 Jan 31 04:56:07.648756 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 523/1036] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:07 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:08.666633 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-931eaea9-cef9-4a3c-adcb-4c8f67ff8680 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:08.667340 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-931eaea9-cef9-4a3c-adcb-4c8f67ff8680 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:08.673257 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-931eaea9-cef9-4a3c-adcb-4c8f67ff8680 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:08.673700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-931eaea9-cef9-4a3c-adcb-4c8f67ff8680 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:08.674466 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-931eaea9-cef9-4a3c-adcb-4c8f67ff8680 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:08.675511 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-931eaea9-cef9-4a3c-adcb-4c8f67ff8680 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:08.961484 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-931eaea9-cef9-4a3c-adcb-4c8f67ff8680 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:08.968656 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-931eaea9-cef9-4a3c-adcb-4c8f67ff8680 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.306496 Jan 31 04:56:08.969145 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 514/1037] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:08 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:09.985157 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2ec1bc2a-327e-4b2b-b60b-1f01a3065ef1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:09.985806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2ec1bc2a-327e-4b2b-b60b-1f01a3065ef1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:09.992814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2ec1bc2a-327e-4b2b-b60b-1f01a3065ef1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:09.993267 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2ec1bc2a-327e-4b2b-b60b-1f01a3065ef1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:09.994152 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2ec1bc2a-327e-4b2b-b60b-1f01a3065ef1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:09.994590 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2ec1bc2a-327e-4b2b-b60b-1f01a3065ef1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:10.134848 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2ec1bc2a-327e-4b2b-b60b-1f01a3065ef1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:10.142377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2ec1bc2a-327e-4b2b-b60b-1f01a3065ef1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.160913 Jan 31 04:56:10.142961 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 524/1038] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:09 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:11.159174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3e53701e-0cb6-43e6-9bc0-f60f5ea37c39 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:11.160280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3e53701e-0cb6-43e6-9bc0-f60f5ea37c39 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:11.167013 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3e53701e-0cb6-43e6-9bc0-f60f5ea37c39 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:11.167458 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3e53701e-0cb6-43e6-9bc0-f60f5ea37c39 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:11.168234 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3e53701e-0cb6-43e6-9bc0-f60f5ea37c39 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:11.168665 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3e53701e-0cb6-43e6-9bc0-f60f5ea37c39 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:11.306042 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-3e53701e-0cb6-43e6-9bc0-f60f5ea37c39 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:11.313187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3e53701e-0cb6-43e6-9bc0-f60f5ea37c39 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.157868 Jan 31 04:56:11.313761 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 515/1039] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:11 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:12.329843 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-afcbd746-4eee-41de-8e14-357a1bdbd6bf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:12.330488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-afcbd746-4eee-41de-8e14-357a1bdbd6bf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:12.338686 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-afcbd746-4eee-41de-8e14-357a1bdbd6bf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:12.339264 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-afcbd746-4eee-41de-8e14-357a1bdbd6bf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:12.340129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-afcbd746-4eee-41de-8e14-357a1bdbd6bf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:12.340482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-afcbd746-4eee-41de-8e14-357a1bdbd6bf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:12.482125 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-afcbd746-4eee-41de-8e14-357a1bdbd6bf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:12.485055 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-afcbd746-4eee-41de-8e14-357a1bdbd6bf tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.159029 Jan 31 04:56:12.485613 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 525/1040] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:12 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:56:13.502320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6f12a9e0-3e41-44f5-8eb2-56ef7c69d7d9 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:13.503058 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6f12a9e0-3e41-44f5-8eb2-56ef7c69d7d9 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:13.509764 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6f12a9e0-3e41-44f5-8eb2-56ef7c69d7d9 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:13.510211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6f12a9e0-3e41-44f5-8eb2-56ef7c69d7d9 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:13.511022 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6f12a9e0-3e41-44f5-8eb2-56ef7c69d7d9 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:13.511460 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6f12a9e0-3e41-44f5-8eb2-56ef7c69d7d9 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:13.649230 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6f12a9e0-3e41-44f5-8eb2-56ef7c69d7d9 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:13.656797 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6f12a9e0-3e41-44f5-8eb2-56ef7c69d7d9 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.158098 Jan 31 04:56:13.657344 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 516/1041] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:13 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:14.673895 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1c67d66a-fb1b-4934-b466-09bfe2012855 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:14.674490 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1c67d66a-fb1b-4934-b466-09bfe2012855 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:14.681253 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1c67d66a-fb1b-4934-b466-09bfe2012855 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:14.681690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1c67d66a-fb1b-4934-b466-09bfe2012855 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:14.682456 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1c67d66a-fb1b-4934-b466-09bfe2012855 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:14.682906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1c67d66a-fb1b-4934-b466-09bfe2012855 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:14.812599 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1c67d66a-fb1b-4934-b466-09bfe2012855 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:14.822354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1c67d66a-fb1b-4934-b466-09bfe2012855 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.152020 Jan 31 04:56:14.822934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 526/1042] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:14 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:15.838872 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bd3a7274-a6b0-466d-b9bc-9d24f2dd782f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:15.839495 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-bd3a7274-a6b0-466d-b9bc-9d24f2dd782f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:15.845645 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd3a7274-a6b0-466d-b9bc-9d24f2dd782f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:15.846089 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd3a7274-a6b0-466d-b9bc-9d24f2dd782f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:15.846883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd3a7274-a6b0-466d-b9bc-9d24f2dd782f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:15.847913 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-bd3a7274-a6b0-466d-b9bc-9d24f2dd782f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:15.979099 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-bd3a7274-a6b0-466d-b9bc-9d24f2dd782f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:15.986296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bd3a7274-a6b0-466d-b9bc-9d24f2dd782f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.151084 Jan 31 04:56:15.986875 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 517/1043] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:15 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:17.004487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-431b48fc-39d8-4599-b1da-77ca334c0376 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:17.005178 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-431b48fc-39d8-4599-b1da-77ca334c0376 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:17.011611 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-431b48fc-39d8-4599-b1da-77ca334c0376 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:17.011953 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-431b48fc-39d8-4599-b1da-77ca334c0376 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:17.012729 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-431b48fc-39d8-4599-b1da-77ca334c0376 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:17.013165 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-431b48fc-39d8-4599-b1da-77ca334c0376 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:17.154292 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-431b48fc-39d8-4599-b1da-77ca334c0376 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:17.162113 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-431b48fc-39d8-4599-b1da-77ca334c0376 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.161693 Jan 31 04:56:17.162734 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 527/1044] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:16 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:18.179374 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-62d9402e-8d69-4c8d-859a-356537a84344 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:18.186957 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-62d9402e-8d69-4c8d-859a-356537a84344 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:18.186957 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62d9402e-8d69-4c8d-859a-356537a84344 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:18.186957 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62d9402e-8d69-4c8d-859a-356537a84344 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:18.187832 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62d9402e-8d69-4c8d-859a-356537a84344 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:18.188275 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62d9402e-8d69-4c8d-859a-356537a84344 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:18.329361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-62d9402e-8d69-4c8d-859a-356537a84344 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:18.336938 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-62d9402e-8d69-4c8d-859a-356537a84344 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.162331 Jan 31 04:56:18.337503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 518/1045] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:18 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:56:19.354193 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-38247758-1657-4138-b00c-9fe2a082b314 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:19.354736 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-38247758-1657-4138-b00c-9fe2a082b314 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:19.360671 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38247758-1657-4138-b00c-9fe2a082b314 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:19.368324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38247758-1657-4138-b00c-9fe2a082b314 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:19.368324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38247758-1657-4138-b00c-9fe2a082b314 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:19.368324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-38247758-1657-4138-b00c-9fe2a082b314 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:19.496054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-38247758-1657-4138-b00c-9fe2a082b314 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:19.503334 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-38247758-1657-4138-b00c-9fe2a082b314 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.152767 Jan 31 04:56:19.504241 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 528/1046] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:19 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:20.520796 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cd3b5c78-274b-4092-91f1-a80df8ef249b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:20.521398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cd3b5c78-274b-4092-91f1-a80df8ef249b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:20.527634 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cd3b5c78-274b-4092-91f1-a80df8ef249b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:20.528081 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cd3b5c78-274b-4092-91f1-a80df8ef249b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:20.528846 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cd3b5c78-274b-4092-91f1-a80df8ef249b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:20.529279 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cd3b5c78-274b-4092-91f1-a80df8ef249b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:20.664460 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cd3b5c78-274b-4092-91f1-a80df8ef249b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:20.671687 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cd3b5c78-274b-4092-91f1-a80df8ef249b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.155059 Jan 31 04:56:20.673161 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 519/1047] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:20 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:21.689702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cc925f91-ca06-4e78-add1-a6fd21f37669 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:21.690346 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cc925f91-ca06-4e78-add1-a6fd21f37669 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:21.697261 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cc925f91-ca06-4e78-add1-a6fd21f37669 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:21.697702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cc925f91-ca06-4e78-add1-a6fd21f37669 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:21.698471 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cc925f91-ca06-4e78-add1-a6fd21f37669 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:21.698927 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cc925f91-ca06-4e78-add1-a6fd21f37669 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:21.832263 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cc925f91-ca06-4e78-add1-a6fd21f37669 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:21.839762 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cc925f91-ca06-4e78-add1-a6fd21f37669 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.153729 Jan 31 04:56:21.840340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 529/1048] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:21 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:22.856807 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-88503086-ec9b-413b-b144-e1c844d57a00 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:22.857405 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-88503086-ec9b-413b-b144-e1c844d57a00 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:22.863966 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-88503086-ec9b-413b-b144-e1c844d57a00 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:22.864399 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-88503086-ec9b-413b-b144-e1c844d57a00 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:22.865162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-88503086-ec9b-413b-b144-e1c844d57a00 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:22.865592 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-88503086-ec9b-413b-b144-e1c844d57a00 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:22.997205 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-88503086-ec9b-413b-b144-e1c844d57a00 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:23.005261 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-88503086-ec9b-413b-b144-e1c844d57a00 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.152152 Jan 31 04:56:23.005817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 520/1049] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:22 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:24.022016 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2573146d-7408-4bbd-8b29-655e85127075 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:24.022707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2573146d-7408-4bbd-8b29-655e85127075 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:24.029057 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2573146d-7408-4bbd-8b29-655e85127075 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:24.029567 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2573146d-7408-4bbd-8b29-655e85127075 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:24.030333 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2573146d-7408-4bbd-8b29-655e85127075 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:24.030762 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2573146d-7408-4bbd-8b29-655e85127075 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:24.173837 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2573146d-7408-4bbd-8b29-655e85127075 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:24.181444 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2573146d-7408-4bbd-8b29-655e85127075 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1566 microversion: 2.1 time: 0.163907 Jan 31 04:56:24.182006 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 530/1050] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:24 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:56:24.198396 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-49e18914-bd2d-4e6e-a14c-04d8b246bdce tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:56:24.199033 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-49e18914-bd2d-4e6e-a14c-04d8b246bdce tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:24.205236 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49e18914-bd2d-4e6e-a14c-04d8b246bdce tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:24.205674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49e18914-bd2d-4e6e-a14c-04d8b246bdce tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:24.216153 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49e18914-bd2d-4e6e-a14c-04d8b246bdce tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:24.216153 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-49e18914-bd2d-4e6e-a14c-04d8b246bdce tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:24.458238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-49e18914-bd2d-4e6e-a14c-04d8b246bdce tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "POST /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759/action" status: 202 len: 0 microversion: 2.1 time: 0.263606 Jan 31 04:56:24.478330 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 521/1051] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:56:24 2022] POST /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:56:24.480129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-70ee9810-7294-4bf6-a1cd-77d11c2920e1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:24.480129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-70ee9810-7294-4bf6-a1cd-77d11c2920e1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:24.480129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-70ee9810-7294-4bf6-a1cd-77d11c2920e1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:24.480129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-70ee9810-7294-4bf6-a1cd-77d11c2920e1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:24.480482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-70ee9810-7294-4bf6-a1cd-77d11c2920e1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:24.480482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-70ee9810-7294-4bf6-a1cd-77d11c2920e1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:24.612481 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-70ee9810-7294-4bf6-a1cd-77d11c2920e1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:24.620153 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-70ee9810-7294-4bf6-a1cd-77d11c2920e1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1574 microversion: 2.1 time: 0.157129 Jan 31 04:56:24.620981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 531/1052] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:24 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:25.638351 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-24e653dc-4fdc-423c-a13a-5d77ed9a09f1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:25.639087 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-24e653dc-4fdc-423c-a13a-5d77ed9a09f1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:25.648333 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-24e653dc-4fdc-423c-a13a-5d77ed9a09f1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:25.648775 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-24e653dc-4fdc-423c-a13a-5d77ed9a09f1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:25.649601 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-24e653dc-4fdc-423c-a13a-5d77ed9a09f1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:25.650035 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-24e653dc-4fdc-423c-a13a-5d77ed9a09f1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:25.784101 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-24e653dc-4fdc-423c-a13a-5d77ed9a09f1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:25.791468 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-24e653dc-4fdc-423c-a13a-5d77ed9a09f1 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1516 microversion: 2.1 time: 0.157237 Jan 31 04:56:25.792051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 522/1053] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:25 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:26.378588 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-5738d77b-1634-4738-a2b6-3d95d46743d6 req-c52a550d-a7e9-413d-a1f7-32eda5f60d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e253ce-c129-44d9-9219-b29dd9feb759", "name": "network-vif-unplugged", "status": "completed", "tag": "93af9573-d882-4ed1-ba22-f2922408b158"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:56:26.383579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:56:26.383579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:56:26.389730 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-5738d77b-1634-4738-a2b6-3d95d46743d6 req-c52a550d-a7e9-413d-a1f7-32eda5f60d81 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:26.390572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-5738d77b-1634-4738-a2b6-3d95d46743d6 req-c52a550d-a7e9-413d-a1f7-32eda5f60d81 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:26.402369 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.compute.server_external_events [req-5738d77b-1634-4738-a2b6-3d95d46743d6 req-c52a550d-a7e9-413d-a1f7-32eda5f60d81 service nova] Unable to find a host for instance 42e253ce-c129-44d9-9219-b29dd9feb759. Dropping event network-vif-unplugged {{(pid=123368) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 31 04:56:26.403259 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-5738d77b-1634-4738-a2b6-3d95d46743d6 req-c52a550d-a7e9-413d-a1f7-32eda5f60d81 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028800 Jan 31 04:56:26.403826 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 532/1054] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 31 04:56:26.809211 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4dfa1c37-e407-44a9-9857-eb62e3a16145 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:26.809904 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4dfa1c37-e407-44a9-9857-eb62e3a16145 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:26.816301 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4dfa1c37-e407-44a9-9857-eb62e3a16145 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:26.816739 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4dfa1c37-e407-44a9-9857-eb62e3a16145 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:26.817504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4dfa1c37-e407-44a9-9857-eb62e3a16145 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:26.817931 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4dfa1c37-e407-44a9-9857-eb62e3a16145 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:26.968961 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4dfa1c37-e407-44a9-9857-eb62e3a16145 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:26.977291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4dfa1c37-e407-44a9-9857-eb62e3a16145 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1516 microversion: 2.1 time: 0.171761 Jan 31 04:56:26.977850 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 523/1055] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:26 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:27.995622 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-00919b1e-4477-4b88-9512-230e7ff3e33d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:27.996328 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-00919b1e-4477-4b88-9512-230e7ff3e33d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:28.002965 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00919b1e-4477-4b88-9512-230e7ff3e33d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:28.003962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00919b1e-4477-4b88-9512-230e7ff3e33d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:28.004787 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00919b1e-4477-4b88-9512-230e7ff3e33d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:28.005414 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00919b1e-4477-4b88-9512-230e7ff3e33d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:28.142563 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-00919b1e-4477-4b88-9512-230e7ff3e33d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:28.150348 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-00919b1e-4477-4b88-9512-230e7ff3e33d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.159747 Jan 31 04:56:28.150926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 533/1056] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:27 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:29.167990 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7c18e3f7-8aa9-4d88-9b89-a30d888c9b1d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:29.168600 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7c18e3f7-8aa9-4d88-9b89-a30d888c9b1d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:29.174687 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7c18e3f7-8aa9-4d88-9b89-a30d888c9b1d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:29.175496 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7c18e3f7-8aa9-4d88-9b89-a30d888c9b1d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:29.176504 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7c18e3f7-8aa9-4d88-9b89-a30d888c9b1d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:29.176938 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7c18e3f7-8aa9-4d88-9b89-a30d888c9b1d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:29.316642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7c18e3f7-8aa9-4d88-9b89-a30d888c9b1d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:29.323831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7c18e3f7-8aa9-4d88-9b89-a30d888c9b1d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.159443 Jan 31 04:56:29.324391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 524/1057] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:29 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:30.341071 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3419e4c3-211f-44d7-86db-303840cb4e85 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:30.341683 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3419e4c3-211f-44d7-86db-303840cb4e85 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:30.347639 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3419e4c3-211f-44d7-86db-303840cb4e85 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:30.348104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3419e4c3-211f-44d7-86db-303840cb4e85 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:30.348875 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3419e4c3-211f-44d7-86db-303840cb4e85 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:30.349306 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3419e4c3-211f-44d7-86db-303840cb4e85 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:30.494161 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3419e4c3-211f-44d7-86db-303840cb4e85 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:30.501589 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3419e4c3-211f-44d7-86db-303840cb4e85 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.164261 Jan 31 04:56:30.502140 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 534/1058] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:30 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:31.517913 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-442e88f5-309d-45a4-b6a2-74a7ee924b51 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:31.518503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-442e88f5-309d-45a4-b6a2-74a7ee924b51 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:31.525279 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-442e88f5-309d-45a4-b6a2-74a7ee924b51 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:31.525722 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-442e88f5-309d-45a4-b6a2-74a7ee924b51 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:31.526491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-442e88f5-309d-45a4-b6a2-74a7ee924b51 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:31.526959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-442e88f5-309d-45a4-b6a2-74a7ee924b51 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:31.656817 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-442e88f5-309d-45a4-b6a2-74a7ee924b51 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:31.664959 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-442e88f5-309d-45a4-b6a2-74a7ee924b51 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.150653 Jan 31 04:56:31.665517 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 525/1059] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:31 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:32.682187 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-97001712-37c7-479a-8269-04dadfec3062 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:32.682745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-97001712-37c7-479a-8269-04dadfec3062 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:32.688852 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-97001712-37c7-479a-8269-04dadfec3062 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:32.689301 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-97001712-37c7-479a-8269-04dadfec3062 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:32.690048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-97001712-37c7-479a-8269-04dadfec3062 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:32.690474 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-97001712-37c7-479a-8269-04dadfec3062 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:32.822939 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-97001712-37c7-479a-8269-04dadfec3062 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:32.830178 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-97001712-37c7-479a-8269-04dadfec3062 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.151724 Jan 31 04:56:32.830741 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 535/1060] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:32 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:33.846729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9a2b2833-6c2f-4d05-99ee-6f79b744d484 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:33.847371 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9a2b2833-6c2f-4d05-99ee-6f79b744d484 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:33.853543 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a2b2833-6c2f-4d05-99ee-6f79b744d484 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:33.853986 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a2b2833-6c2f-4d05-99ee-6f79b744d484 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:33.854759 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a2b2833-6c2f-4d05-99ee-6f79b744d484 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:33.855219 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a2b2833-6c2f-4d05-99ee-6f79b744d484 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:33.990933 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9a2b2833-6c2f-4d05-99ee-6f79b744d484 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:33.998736 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9a2b2833-6c2f-4d05-99ee-6f79b744d484 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.155922 Jan 31 04:56:33.999329 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 526/1061] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:33 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:35.016185 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-af27f2c1-2184-4ed8-9613-2d855554b001 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:35.016797 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-af27f2c1-2184-4ed8-9613-2d855554b001 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:35.023715 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af27f2c1-2184-4ed8-9613-2d855554b001 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:35.024166 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af27f2c1-2184-4ed8-9613-2d855554b001 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:35.024938 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af27f2c1-2184-4ed8-9613-2d855554b001 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:35.025375 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af27f2c1-2184-4ed8-9613-2d855554b001 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:35.164476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-af27f2c1-2184-4ed8-9613-2d855554b001 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:35.171778 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-af27f2c1-2184-4ed8-9613-2d855554b001 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.159279 Jan 31 04:56:35.172345 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 536/1062] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:35 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:36.188106 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4906b1ff-5911-491f-bba1-0f655934d151 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:36.188706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4906b1ff-5911-491f-bba1-0f655934d151 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:36.194995 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4906b1ff-5911-491f-bba1-0f655934d151 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:36.195435 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4906b1ff-5911-491f-bba1-0f655934d151 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:36.196196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4906b1ff-5911-491f-bba1-0f655934d151 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:36.196623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4906b1ff-5911-491f-bba1-0f655934d151 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:36.326071 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4906b1ff-5911-491f-bba1-0f655934d151 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:36.333741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4906b1ff-5911-491f-bba1-0f655934d151 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.149304 Jan 31 04:56:36.334294 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 527/1063] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:36 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:37.350823 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-303ccbad-5148-41fe-9f14-52f9f4e73c3b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:37.351368 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-303ccbad-5148-41fe-9f14-52f9f4e73c3b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:37.357462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-303ccbad-5148-41fe-9f14-52f9f4e73c3b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:37.357902 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-303ccbad-5148-41fe-9f14-52f9f4e73c3b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:37.358658 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-303ccbad-5148-41fe-9f14-52f9f4e73c3b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:37.359112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-303ccbad-5148-41fe-9f14-52f9f4e73c3b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:37.494201 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-303ccbad-5148-41fe-9f14-52f9f4e73c3b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:37.502454 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-303ccbad-5148-41fe-9f14-52f9f4e73c3b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.155604 Jan 31 04:56:37.503103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 537/1064] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:37 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:38.215154 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e18b6c8d-a37e-46b9-a1b6-0a7471cbf032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:38.216157 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e18b6c8d-a37e-46b9-a1b6-0a7471cbf032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:38.223337 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e18b6c8d-a37e-46b9-a1b6-0a7471cbf032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:38.223812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e18b6c8d-a37e-46b9-a1b6-0a7471cbf032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:38.228583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e18b6c8d-a37e-46b9-a1b6-0a7471cbf032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:38.228583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e18b6c8d-a37e-46b9-a1b6-0a7471cbf032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:38.254829 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e18b6c8d-a37e-46b9-a1b6-0a7471cbf032 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043389 Jan 31 04:56:38.255531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 528/1065] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Jan 31 04:56:38 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:38.320754 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6c468c3e-0e33-44ec-a730-31618e561cd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:38.320937 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6c468c3e-0e33-44ec-a730-31618e561cd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:38.326957 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c468c3e-0e33-44ec-a730-31618e561cd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:38.327408 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c468c3e-0e33-44ec-a730-31618e561cd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:38.328188 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c468c3e-0e33-44ec-a730-31618e561cd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:38.328626 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6c468c3e-0e33-44ec-a730-31618e561cd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:38.353396 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6c468c3e-0e33-44ec-a730-31618e561cd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:56:38.519728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a5a70ed6-3f7f-40fc-9c8b-7d4232255c96 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:38.520329 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a5a70ed6-3f7f-40fc-9c8b-7d4232255c96 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:38.526040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5a70ed6-3f7f-40fc-9c8b-7d4232255c96 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:38.526450 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5a70ed6-3f7f-40fc-9c8b-7d4232255c96 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:38.527234 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5a70ed6-3f7f-40fc-9c8b-7d4232255c96 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:38.527660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a5a70ed6-3f7f-40fc-9c8b-7d4232255c96 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:38.644688 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6c468c3e-0e33-44ec-a730-31618e561cd1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 204 len: 0 microversion: 2.20 time: 0.328110 Jan 31 04:56:38.645412 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 538/1066] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Jan 31 04:56:38 2022] DELETE /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 31 04:56:38.657282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:38.658092 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:38.664120 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:38.664632 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:38.665529 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:38.665849 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:38.672572 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a5a70ed6-3f7f-40fc-9c8b-7d4232255c96 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:38.684412 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a5a70ed6-3f7f-40fc-9c8b-7d4232255c96 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.168286 Jan 31 04:56:38.685195 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 529/1067] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:38 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:56:38.802098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:38.814627 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:38.817974 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:38.819294 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ff015336-2521-401b-a2b3-ab59dc9c8668 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.166188 Jan 31 04:56:38.820056 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 539/1068] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:56:38 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:56:39.701687 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0a29d47c-cac1-4324-8c35-81dd582a12b4 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:39.702360 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0a29d47c-cac1-4324-8c35-81dd582a12b4 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:39.709321 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0a29d47c-cac1-4324-8c35-81dd582a12b4 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:39.709764 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0a29d47c-cac1-4324-8c35-81dd582a12b4 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:39.710538 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0a29d47c-cac1-4324-8c35-81dd582a12b4 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:39.711004 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0a29d47c-cac1-4324-8c35-81dd582a12b4 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:39.836860 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:39.837493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:39.843699 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:39.844140 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:39.844908 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:39.845340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:39.845478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0a29d47c-cac1-4324-8c35-81dd582a12b4 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:39.853384 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0a29d47c-cac1-4324-8c35-81dd582a12b4 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.155307 Jan 31 04:56:39.853953 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 530/1069] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:39 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:39.981145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:39.989748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:39.991285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:39.992457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-8a9314a2-b0a4-48af-8d21-ddb5fcc809be tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.159335 Jan 31 04:56:39.993009 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 540/1070] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:56:39 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:56:40.510280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-b10fd683-9cd4-4194-8c95-808b0b944a81 req-498667a3-9cf6-4906-93e6-99a6d85fc8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e253ce-c129-44d9-9219-b29dd9feb759", "name": "network-vif-plugged", "status": "completed", "tag": "93af9573-d882-4ed1-ba22-f2922408b158"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:56:40.511853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:56:40.511853 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:56:40.523463 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-b10fd683-9cd4-4194-8c95-808b0b944a81 req-498667a3-9cf6-4906-93e6-99a6d85fc8c8 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:40.523463 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-b10fd683-9cd4-4194-8c95-808b0b944a81 req-498667a3-9cf6-4906-93e6-99a6d85fc8c8 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:40.530891 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-b10fd683-9cd4-4194-8c95-808b0b944a81 req-498667a3-9cf6-4906-93e6-99a6d85fc8c8 service nova] Creating event network-vif-plugged:93af9573-d882-4ed1-ba22-f2922408b158 for instance 42e253ce-c129-44d9-9219-b29dd9feb759 on hv-cinder-82660 Jan 31 04:56:40.536040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-b10fd683-9cd4-4194-8c95-808b0b944a81 req-498667a3-9cf6-4906-93e6-99a6d85fc8c8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029417 Jan 31 04:56:40.536601 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 531/1071] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:56:40.870619 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d3518177-c5a1-4a0b-85bc-b010ed7ed711 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:40.871287 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d3518177-c5a1-4a0b-85bc-b010ed7ed711 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:40.877462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d3518177-c5a1-4a0b-85bc-b010ed7ed711 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:40.878494 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d3518177-c5a1-4a0b-85bc-b010ed7ed711 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:40.879553 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d3518177-c5a1-4a0b-85bc-b010ed7ed711 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:40.880002 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d3518177-c5a1-4a0b-85bc-b010ed7ed711 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:41.012587 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:41.013437 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:41.019719 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:41.020245 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:41.021063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:41.021511 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:41.137219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d3518177-c5a1-4a0b-85bc-b010ed7ed711 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:41.145231 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d3518177-c5a1-4a0b-85bc-b010ed7ed711 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.278470 Jan 31 04:56:41.146024 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 541/1072] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:40 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:41.155388 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:41.164001 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:41.165598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:41.166915 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2dcb4397-a84b-4e1c-905f-84132dcff9fd tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1722 microversion: 2.20 time: 0.158825 Jan 31 04:56:41.167525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 532/1073] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:56:41 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:56:41.797819 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-cee9ca15-350b-4716-aa92-9bb0409f1cc8 req-46e8bd35-66de-44fe-8347-0cf29756a865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c83adf7-7265-467f-a4cc-1d9d0252b24f", "name": "network-vif-deleted", "tag": "1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:56:41.799451 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:56:41.799451 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:56:41.806840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-cee9ca15-350b-4716-aa92-9bb0409f1cc8 req-46e8bd35-66de-44fe-8347-0cf29756a865 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:41.807285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-cee9ca15-350b-4716-aa92-9bb0409f1cc8 req-46e8bd35-66de-44fe-8347-0cf29756a865 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:41.822174 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-cee9ca15-350b-4716-aa92-9bb0409f1cc8 req-46e8bd35-66de-44fe-8347-0cf29756a865 service nova] Creating event network-vif-deleted:1140a716-79f3-4fa4-a1a5-dbbbd1a88a4a for instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f on hv-cinder-82660 Jan 31 04:56:41.835314 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-cee9ca15-350b-4716-aa92-9bb0409f1cc8 req-46e8bd35-66de-44fe-8347-0cf29756a865 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205441 Jan 31 04:56:41.836476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 542/1074] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:56:42.162258 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b506414a-b01c-466e-9cc9-23a1d793194a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:42.163590 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b506414a-b01c-466e-9cc9-23a1d793194a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:42.170555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b506414a-b01c-466e-9cc9-23a1d793194a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:42.171292 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b506414a-b01c-466e-9cc9-23a1d793194a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:42.172469 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b506414a-b01c-466e-9cc9-23a1d793194a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:42.172964 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b506414a-b01c-466e-9cc9-23a1d793194a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:42.186042 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:42.186840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:42.195932 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:42.196702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:42.197798 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:42.198747 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:42.233742 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:42.234189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:42.234636 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lazy-loading 'fault' on Instance uuid 1c83adf7-7265-467f-a4cc-1d9d0252b24f {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:56:42.286865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:42.297991 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:42.300484 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa68ebb7220c4e6383128947fc970877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3951fb700ad04745afa04a4b077da951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:42.303353 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-bd2306ff-eaee-4621-9ce7-82b54685411c tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 200 len: 1372 microversion: 2.20 time: 0.119971 Jan 31 04:56:42.304081 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 543/1075] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:56:42 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 04:56:42.359700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b506414a-b01c-466e-9cc9-23a1d793194a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:42.368038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b506414a-b01c-466e-9cc9-23a1d793194a tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1572 microversion: 2.1 time: 0.210396 Jan 31 04:56:42.378316 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 533/1076] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:42 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1572 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:56:43.321814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:43.322390 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:43.328719 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:43.329158 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:43.329921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:43.330347 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:43.343315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] HTTP exception thrown: Instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f could not be found. Jan 31 04:56:43.343891 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Returning 404 to user: Instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:56:43.344695 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-414ac04b-f5b2-4b64-ba9b-11d9a5e9a4d1 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 404 len: 111 microversion: 2.20 time: 0.026589 Jan 31 04:56:43.345614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 544/1077] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:56:43 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 04:56:43.353777 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-517b182e-665a-46c8-871e-e619cb1c9d61 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '.version_select at 0x7f69f52e5160>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:43.385480 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c8222e80-0007-4665-b7a0-08d6edb4f15d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:43.387485 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c8222e80-0007-4665-b7a0-08d6edb4f15d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:43.392209 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c8222e80-0007-4665-b7a0-08d6edb4f15d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:43.392636 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c8222e80-0007-4665-b7a0-08d6edb4f15d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:43.393404 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c8222e80-0007-4665-b7a0-08d6edb4f15d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:43.393827 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c8222e80-0007-4665-b7a0-08d6edb4f15d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:43.430114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-517b182e-665a-46c8-871e-e619cb1c9d61 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117279196" status: 204 len: 0 microversion: 2.20 time: 0.079859 Jan 31 04:56:43.430661 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 534/1078] 10.222.0.21 () {60 vars in 1261 bytes} [Mon Jan 31 04:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117279196 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 31 04:56:43.550621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c8222e80-0007-4665-b7a0-08d6edb4f15d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:56:43.561365 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c8222e80-0007-4665-b7a0-08d6edb4f15d tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1559 microversion: 2.1 time: 0.179646 Jan 31 04:56:43.572083 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 545/1079] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:56:43 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:56:45.493715 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:45.494229 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:45.501010 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:45.501505 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:45.502267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:45.502693 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:45.517520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] HTTP exception thrown: Instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f could not be found. Jan 31 04:56:45.518103 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Returning 404 to user: Instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:56:45.522769 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f1c733e9-6ae2-4404-af4a-ea55e12aead6 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 404 len: 111 microversion: 2.20 time: 0.028763 Jan 31 04:56:45.522769 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 535/1080] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Jan 31 04:56:45 2022] DELETE /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 04:56:45.527817 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:45.528428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: 1c83adf7-7265-467f-a4cc-1d9d0252b24f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:45.535382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:45.535841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:45.536617 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:45.537052 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:45.550032 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] HTTP exception thrown: Instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f could not be found. Jan 31 04:56:45.551392 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Returning 404 to user: Instance 1c83adf7-7265-467f-a4cc-1d9d0252b24f could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:56:45.551500 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2a3dc0e2-7b24-4e2f-b8b4-22160a47e37f tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f" status: 404 len: 111 microversion: 2.20 time: 0.027354 Jan 31 04:56:45.551972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 546/1081] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:56:45 2022] GET /compute/v2.1/servers/1c83adf7-7265-467f-a4cc-1d9d0252b24f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 04:56:46.838446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:46.838986 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:46.845096 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:46.845542 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:46.846302 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:46.846728 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:46.860123 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] HTTP exception thrown: Instance dde1517d-e13d-455c-a8dd-0119bb29148b could not be found. Jan 31 04:56:46.860687 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Returning 404 to user: Instance dde1517d-e13d-455c-a8dd-0119bb29148b could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:56:46.861477 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-41cdd98b-a77c-4458-8c50-0b34d40fbc66 tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "DELETE /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 404 len: 111 microversion: 2.20 time: 0.026807 Jan 31 04:56:46.862029 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 536/1082] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Jan 31 04:56:46 2022] DELETE /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 04:56:46.869653 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:56:46.870515 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] [instance: dde1517d-e13d-455c-a8dd-0119bb29148b] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:56:46.876845 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:46.877289 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:46.878081 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:56:46.878944 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:56:46.891770 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] HTTP exception thrown: Instance dde1517d-e13d-455c-a8dd-0119bb29148b could not be found. Jan 31 04:56:46.892344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] Returning 404 to user: Instance dde1517d-e13d-455c-a8dd-0119bb29148b could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:56:46.893183 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-af7e3beb-51a7-4ba1-80aa-312462e84b4e tempest-AttachVolumeShelveTestJSON-1428651211 tempest-AttachVolumeShelveTestJSON-1428651211-project] 10.222.0.21 "GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b" status: 404 len: 111 microversion: 2.20 time: 0.027208 Jan 31 04:56:46.893716 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 547/1083] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Jan 31 04:56:46 2022] GET /compute/v2.1/servers/dde1517d-e13d-455c-a8dd-0119bb29148b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 04:57:32.202037 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-bf59d354-ac95-4634-81e8-04345717e39c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Action: 'create', calling method: .version_select at 0x7f69f532cf70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-581066051"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:57:32.215635 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-bf59d354-ac95-4634-81e8-04345717e39c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Getting quotas for project e1637f6e48094653bebf0bc7af9aab9a. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:57:32.219339 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-bf59d354-ac95-4634-81e8-04345717e39c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Getting quotas for user 02c59be1b62c4774a050047b4f5364d9 and project e1637f6e48094653bebf0bc7af9aab9a. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:57:32.528065 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-bf59d354-ac95-4634-81e8-04345717e39c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Getting quotas for project e1637f6e48094653bebf0bc7af9aab9a. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:57:32.531771 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-bf59d354-ac95-4634-81e8-04345717e39c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Getting quotas for user 02c59be1b62c4774a050047b4f5364d9 and project e1637f6e48094653bebf0bc7af9aab9a. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:57:32.544535 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-bf59d354-ac95-4634-81e8-04345717e39c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.346109 Jan 31 04:57:32.545120 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 537/1084] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Jan 31 04:57:32 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:32.641176 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-721015444", "imageRef": "5676aaef-e492-4703-85dc-bf231886a7bd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-581066051", "networks": [{"uuid": "857a60d4-e4ef-4584-aa7d-b453d98e2609"}]}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:57:32.690210 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] validate_networks() for [('857a60d4-e4ef-4584-aa7d-b453d98e2609', None, None, None, None, None)] {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:57:33.146053 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:57:33.146469 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:57:33.146968 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:57:33.147392 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:57:33.147789 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:57:33.156204 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:33.156645 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:33.157434 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:33.158476 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:33.174608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Getting quotas for project e1637f6e48094653bebf0bc7af9aab9a. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:57:33.178441 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Getting quotas for user 02c59be1b62c4774a050047b4f5364d9 and project e1637f6e48094653bebf0bc7af9aab9a. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:57:33.189474 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:57:33.191704 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5676aaef-e492-4703-85dc-bf231886a7bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:57:33.335853 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-03aaae73-e900-4dc3-93ad-7e2a0ba68b31 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698311 Jan 31 04:57:33.336498 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 548/1085] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:57:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:57:33.347746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-1a83af10-ce53-43d6-a084-77a95ac5ff7e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:33.348361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-1a83af10-ce53-43d6-a084-77a95ac5ff7e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:33.400110 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-1a83af10-ce53-43d6-a084-77a95ac5ff7e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:33.407638 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-1a83af10-ce53-43d6-a084-77a95ac5ff7e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1257 microversion: 2.1 time: 0.064972 Jan 31 04:57:33.408751 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 538/1086] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:33 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:34.426852 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-60f91045-6afa-498a-9c4e-b347076a522c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:34.427489 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-60f91045-6afa-498a-9c4e-b347076a522c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:34.436690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60f91045-6afa-498a-9c4e-b347076a522c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:34.437412 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60f91045-6afa-498a-9c4e-b347076a522c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:34.438745 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60f91045-6afa-498a-9c4e-b347076a522c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:34.439452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-60f91045-6afa-498a-9c4e-b347076a522c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:34.509593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-60f91045-6afa-498a-9c4e-b347076a522c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:34.518271 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-60f91045-6afa-498a-9c4e-b347076a522c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1261 microversion: 2.1 time: 0.096533 Jan 31 04:57:34.518831 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 549/1087] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:34 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1261 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:35.534681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-39666235-a612-42fa-b18c-375e1bbd1f45 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:35.535897 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-39666235-a612-42fa-b18c-375e1bbd1f45 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:35.542114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-39666235-a612-42fa-b18c-375e1bbd1f45 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:35.542549 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-39666235-a612-42fa-b18c-375e1bbd1f45 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:35.543352 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-39666235-a612-42fa-b18c-375e1bbd1f45 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:35.543774 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-39666235-a612-42fa-b18c-375e1bbd1f45 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:35.604447 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-39666235-a612-42fa-b18c-375e1bbd1f45 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:35.612868 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-39666235-a612-42fa-b18c-375e1bbd1f45 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1327 microversion: 2.1 time: 0.081815 Jan 31 04:57:35.613436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 539/1088] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:35 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1327 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:36.631337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9eaddff3-2bcf-4d45-965e-4081e4c0b304 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:36.632177 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9eaddff3-2bcf-4d45-965e-4081e4c0b304 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:36.641801 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9eaddff3-2bcf-4d45-965e-4081e4c0b304 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:36.643425 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9eaddff3-2bcf-4d45-965e-4081e4c0b304 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:36.647840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9eaddff3-2bcf-4d45-965e-4081e4c0b304 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:36.647840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9eaddff3-2bcf-4d45-965e-4081e4c0b304 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:36.809235 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9eaddff3-2bcf-4d45-965e-4081e4c0b304 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:36.818256 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9eaddff3-2bcf-4d45-965e-4081e4c0b304 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.192476 Jan 31 04:57:36.819487 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 550/1089] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:36 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:37.836634 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-6057346d-73f8-4185-85f1-f6423c391eb4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:37.843442 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-6057346d-73f8-4185-85f1-f6423c391eb4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:37.851272 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6057346d-73f8-4185-85f1-f6423c391eb4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:37.851814 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6057346d-73f8-4185-85f1-f6423c391eb4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:37.852608 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6057346d-73f8-4185-85f1-f6423c391eb4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:37.853045 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-6057346d-73f8-4185-85f1-f6423c391eb4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:38.042488 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-6057346d-73f8-4185-85f1-f6423c391eb4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:38.054359 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-6057346d-73f8-4185-85f1-f6423c391eb4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.221546 Jan 31 04:57:38.055080 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 540/1090] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:37 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:39.071120 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f5cbb987-71e8-4d18-a81b-01e59742066a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:39.071735 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f5cbb987-71e8-4d18-a81b-01e59742066a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:39.077933 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f5cbb987-71e8-4d18-a81b-01e59742066a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:39.078376 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f5cbb987-71e8-4d18-a81b-01e59742066a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:39.079188 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f5cbb987-71e8-4d18-a81b-01e59742066a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:39.080054 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f5cbb987-71e8-4d18-a81b-01e59742066a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:39.230941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f5cbb987-71e8-4d18-a81b-01e59742066a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:39.239470 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f5cbb987-71e8-4d18-a81b-01e59742066a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.171939 Jan 31 04:57:39.250195 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 551/1091] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:39 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:40.257748 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4cf6ec55-cab2-49ad-b493-b9960604a228 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:40.258312 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4cf6ec55-cab2-49ad-b493-b9960604a228 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:40.264713 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4cf6ec55-cab2-49ad-b493-b9960604a228 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:40.265164 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4cf6ec55-cab2-49ad-b493-b9960604a228 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:40.266041 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4cf6ec55-cab2-49ad-b493-b9960604a228 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:40.266479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4cf6ec55-cab2-49ad-b493-b9960604a228 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:40.468104 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4cf6ec55-cab2-49ad-b493-b9960604a228 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:40.480446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4cf6ec55-cab2-49ad-b493-b9960604a228 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.226509 Jan 31 04:57:40.481680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 541/1092] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:40 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:41.499453 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d64878c7-ada0-4556-bbf5-af9dcb82336c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:41.500865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d64878c7-ada0-4556-bbf5-af9dcb82336c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:41.513127 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d64878c7-ada0-4556-bbf5-af9dcb82336c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:41.513572 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d64878c7-ada0-4556-bbf5-af9dcb82336c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:41.514365 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d64878c7-ada0-4556-bbf5-af9dcb82336c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:41.521633 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d64878c7-ada0-4556-bbf5-af9dcb82336c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:41.714053 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d64878c7-ada0-4556-bbf5-af9dcb82336c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:41.723321 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d64878c7-ada0-4556-bbf5-af9dcb82336c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.228220 Jan 31 04:57:41.724667 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 552/1093] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:41 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:42.743200 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-930ba6a5-f11c-439d-8cf8-c924cde7ff78 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:42.745182 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-930ba6a5-f11c-439d-8cf8-c924cde7ff78 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:42.753801 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-930ba6a5-f11c-439d-8cf8-c924cde7ff78 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:42.754764 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-930ba6a5-f11c-439d-8cf8-c924cde7ff78 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:42.756438 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-930ba6a5-f11c-439d-8cf8-c924cde7ff78 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:42.757313 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-930ba6a5-f11c-439d-8cf8-c924cde7ff78 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:43.305606 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-930ba6a5-f11c-439d-8cf8-c924cde7ff78 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:43.313507 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-930ba6a5-f11c-439d-8cf8-c924cde7ff78 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.575936 Jan 31 04:57:43.326938 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 542/1094] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:42 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:44.330400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-0d88e688-ca89-4a62-9eed-bc119e44148e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:44.331168 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-0d88e688-ca89-4a62-9eed-bc119e44148e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:44.341025 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0d88e688-ca89-4a62-9eed-bc119e44148e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:44.342094 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0d88e688-ca89-4a62-9eed-bc119e44148e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:44.344311 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0d88e688-ca89-4a62-9eed-bc119e44148e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:44.346223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-0d88e688-ca89-4a62-9eed-bc119e44148e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:44.676106 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-0d88e688-ca89-4a62-9eed-bc119e44148e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:44.687371 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-0d88e688-ca89-4a62-9eed-bc119e44148e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.360801 Jan 31 04:57:44.687961 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 553/1095] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:44 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:45.705598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-59708744-47d3-4f9f-9f48-df579b0247e1 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:45.706441 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-59708744-47d3-4f9f-9f48-df579b0247e1 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:45.717312 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59708744-47d3-4f9f-9f48-df579b0247e1 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:45.717764 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59708744-47d3-4f9f-9f48-df579b0247e1 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:45.718578 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59708744-47d3-4f9f-9f48-df579b0247e1 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:45.719087 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-59708744-47d3-4f9f-9f48-df579b0247e1 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:45.893886 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-59708744-47d3-4f9f-9f48-df579b0247e1 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:45.913370 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-59708744-47d3-4f9f-9f48-df579b0247e1 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.211911 Jan 31 04:57:45.913948 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 543/1096] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:45 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:46.933864 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2037bc1b-73a1-431f-9f17-c51d2102daaf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:46.933864 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2037bc1b-73a1-431f-9f17-c51d2102daaf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:46.939690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2037bc1b-73a1-431f-9f17-c51d2102daaf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:46.940540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2037bc1b-73a1-431f-9f17-c51d2102daaf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:46.941442 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2037bc1b-73a1-431f-9f17-c51d2102daaf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:46.941979 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2037bc1b-73a1-431f-9f17-c51d2102daaf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:47.087813 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2037bc1b-73a1-431f-9f17-c51d2102daaf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:47.097103 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2037bc1b-73a1-431f-9f17-c51d2102daaf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.170962 Jan 31 04:57:47.097682 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 554/1097] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:46 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:48.113500 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-adcc1fdd-56d6-45da-9703-1be29f569c9c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:48.114136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-adcc1fdd-56d6-45da-9703-1be29f569c9c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:48.122066 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-adcc1fdd-56d6-45da-9703-1be29f569c9c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:48.127009 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-adcc1fdd-56d6-45da-9703-1be29f569c9c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:48.130015 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-adcc1fdd-56d6-45da-9703-1be29f569c9c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:48.130015 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-adcc1fdd-56d6-45da-9703-1be29f569c9c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:48.502359 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-adcc1fdd-56d6-45da-9703-1be29f569c9c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:48.514372 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-adcc1fdd-56d6-45da-9703-1be29f569c9c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.403362 Jan 31 04:57:48.514372 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 544/1098] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:48 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:48.746448 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-ab6b0a9f-7c7e-4723-bd95-65275aed5d8e req-7c2e603d-d2a0-4686-9623-9d51fa619efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8e9031-6c59-42e9-9220-6a99b06a7b65", "tag": "51f5ced7-36d1-4a88-8073-6035ed00ae5d"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:57:48.749139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:57:48.749139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:57:48.785530 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ab6b0a9f-7c7e-4723-bd95-65275aed5d8e req-7c2e603d-d2a0-4686-9623-9d51fa619efd service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:48.791007 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ab6b0a9f-7c7e-4723-bd95-65275aed5d8e req-7c2e603d-d2a0-4686-9623-9d51fa619efd service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:48.816728 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-ab6b0a9f-7c7e-4723-bd95-65275aed5d8e req-7c2e603d-d2a0-4686-9623-9d51fa619efd service nova] Creating event network-changed:51f5ced7-36d1-4a88-8073-6035ed00ae5d for instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 on hv-cinder-82660 Jan 31 04:57:48.824755 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-ab6b0a9f-7c7e-4723-bd95-65275aed5d8e req-7c2e603d-d2a0-4686-9623-9d51fa619efd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082252 Jan 31 04:57:48.830488 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 555/1099] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:57:49.531027 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2ac6f853-a9dc-4b45-96d5-a2031f82c72a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:49.531640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2ac6f853-a9dc-4b45-96d5-a2031f82c72a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:49.540174 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2ac6f853-a9dc-4b45-96d5-a2031f82c72a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:49.540746 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2ac6f853-a9dc-4b45-96d5-a2031f82c72a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:49.541465 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2ac6f853-a9dc-4b45-96d5-a2031f82c72a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:49.541893 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2ac6f853-a9dc-4b45-96d5-a2031f82c72a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:49.733885 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2ac6f853-a9dc-4b45-96d5-a2031f82c72a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:49.742991 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2ac6f853-a9dc-4b45-96d5-a2031f82c72a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.216960 Jan 31 04:57:49.755702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 545/1100] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:49 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:50.763708 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-868a3bb2-66e4-4c26-9753-a95fe1d99daf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:50.764407 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-868a3bb2-66e4-4c26-9753-a95fe1d99daf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:50.774389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-868a3bb2-66e4-4c26-9753-a95fe1d99daf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:50.774878 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-868a3bb2-66e4-4c26-9753-a95fe1d99daf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:50.780340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-868a3bb2-66e4-4c26-9753-a95fe1d99daf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:50.780340 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-868a3bb2-66e4-4c26-9753-a95fe1d99daf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:51.038020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-868a3bb2-66e4-4c26-9753-a95fe1d99daf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:51.047890 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-868a3bb2-66e4-4c26-9753-a95fe1d99daf tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.288080 Jan 31 04:57:51.049748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 556/1101] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:50 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:52.066077 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b91db8b0-b652-4559-b971-33a9b07c9b8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:52.066685 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b91db8b0-b652-4559-b971-33a9b07c9b8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:52.072934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b91db8b0-b652-4559-b971-33a9b07c9b8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:52.073323 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b91db8b0-b652-4559-b971-33a9b07c9b8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:52.074090 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b91db8b0-b652-4559-b971-33a9b07c9b8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:52.074523 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b91db8b0-b652-4559-b971-33a9b07c9b8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:52.253320 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b91db8b0-b652-4559-b971-33a9b07c9b8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:52.261090 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b91db8b0-b652-4559-b971-33a9b07c9b8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.199475 Jan 31 04:57:52.266686 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 546/1102] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:52 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:53.278462 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ecd1c490-2d35-42fb-b6c0-f3286d26fe8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:53.279120 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ecd1c490-2d35-42fb-b6c0-f3286d26fe8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:53.286378 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecd1c490-2d35-42fb-b6c0-f3286d26fe8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:53.286858 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecd1c490-2d35-42fb-b6c0-f3286d26fe8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:53.287621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecd1c490-2d35-42fb-b6c0-f3286d26fe8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:53.288053 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecd1c490-2d35-42fb-b6c0-f3286d26fe8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:53.449398 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ecd1c490-2d35-42fb-b6c0-f3286d26fe8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:53.458473 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ecd1c490-2d35-42fb-b6c0-f3286d26fe8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.183548 Jan 31 04:57:53.459205 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 557/1103] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:53 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:53.769607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5d265574-3cf2-44e8-ad44-92d8d0d9256a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Action: 'create', calling method: .version_select at 0x7f69f52e59d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2002478922"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:57:53.782644 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-5d265574-3cf2-44e8-ad44-92d8d0d9256a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:57:53.786206 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-5d265574-3cf2-44e8-ad44-92d8d0d9256a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for user bcaad1042b434b5a8ff8f3a0acc585ec and project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:57:54.144658 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-5d265574-3cf2-44e8-ad44-92d8d0d9256a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:57:54.154287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-5d265574-3cf2-44e8-ad44-92d8d0d9256a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for user bcaad1042b434b5a8ff8f3a0acc585ec and project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'key_pairs'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:57:54.161280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5d265574-3cf2-44e8-ad44-92d8d0d9256a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.553939 Jan 31 04:57:54.161869 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 547/1104] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Jan 31 04:57:53 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:54.476190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cb597e32-daa5-4844-a404-dee3ae47ce97 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:54.476734 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cb597e32-daa5-4844-a404-dee3ae47ce97 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:54.482862 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb597e32-daa5-4844-a404-dee3ae47ce97 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:54.483303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb597e32-daa5-4844-a404-dee3ae47ce97 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:54.487068 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb597e32-daa5-4844-a404-dee3ae47ce97 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:54.487068 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cb597e32-daa5-4844-a404-dee3ae47ce97 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:54.650873 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cb597e32-daa5-4844-a404-dee3ae47ce97 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:54.662436 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cb597e32-daa5-4844-a404-dee3ae47ce97 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.189728 Jan 31 04:57:54.663067 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 558/1105] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:54 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:55.176060 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-3f2e968f-bde6-4320-8231-32020815fdf7 req-b630974a-7909-4629-8c93-926425311fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8e9031-6c59-42e9-9220-6a99b06a7b65", "name": "network-vif-plugged", "status": "completed", "tag": "51f5ced7-36d1-4a88-8073-6035ed00ae5d"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:57:55.179407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:57:55.179407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:57:55.186055 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-3f2e968f-bde6-4320-8231-32020815fdf7 req-b630974a-7909-4629-8c93-926425311fa8 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:55.186558 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-3f2e968f-bde6-4320-8231-32020815fdf7 req-b630974a-7909-4629-8c93-926425311fa8 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:55.197940 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-3f2e968f-bde6-4320-8231-32020815fdf7 req-b630974a-7909-4629-8c93-926425311fa8 service nova] Creating event network-vif-plugged:51f5ced7-36d1-4a88-8073-6035ed00ae5d for instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 on hv-cinder-82660 Jan 31 04:57:55.204781 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-3f2e968f-bde6-4320-8231-32020815fdf7 req-b630974a-7909-4629-8c93-926425311fa8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130692 Jan 31 04:57:55.205468 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 548/1106] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:57:55.679791 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ecb97d32-9d31-4e8c-aaa8-8abc20e7cdc4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:55.680397 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ecb97d32-9d31-4e8c-aaa8-8abc20e7cdc4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:55.686972 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecb97d32-9d31-4e8c-aaa8-8abc20e7cdc4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:55.687422 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecb97d32-9d31-4e8c-aaa8-8abc20e7cdc4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:55.688911 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecb97d32-9d31-4e8c-aaa8-8abc20e7cdc4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:55.689363 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ecb97d32-9d31-4e8c-aaa8-8abc20e7cdc4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:55.901619 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ecb97d32-9d31-4e8c-aaa8-8abc20e7cdc4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:55.909862 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ecb97d32-9d31-4e8c-aaa8-8abc20e7cdc4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.233815 Jan 31 04:57:55.910423 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 559/1107] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:55 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:56.927125 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ddeda5b1-47e8-4ce4-aaf5-dd374b49b9db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:56.928544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ddeda5b1-47e8-4ce4-aaf5-dd374b49b9db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:56.936078 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ddeda5b1-47e8-4ce4-aaf5-dd374b49b9db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:56.936801 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ddeda5b1-47e8-4ce4-aaf5-dd374b49b9db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:56.937854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ddeda5b1-47e8-4ce4-aaf5-dd374b49b9db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:56.939184 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ddeda5b1-47e8-4ce4-aaf5-dd374b49b9db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:57.090822 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ddeda5b1-47e8-4ce4-aaf5-dd374b49b9db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:57.098755 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ddeda5b1-47e8-4ce4-aaf5-dd374b49b9db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1357 microversion: 2.1 time: 0.175827 Jan 31 04:57:57.099349 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 549/1108] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:56 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:58.115111 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4270d94e-7503-4467-b925-e6b2095afba4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:58.115721 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4270d94e-7503-4467-b925-e6b2095afba4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:58.122773 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4270d94e-7503-4467-b925-e6b2095afba4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:58.123239 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4270d94e-7503-4467-b925-e6b2095afba4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:58.124117 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4270d94e-7503-4467-b925-e6b2095afba4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:58.124685 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4270d94e-7503-4467-b925-e6b2095afba4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:58.258190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4270d94e-7503-4467-b925-e6b2095afba4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:58.265451 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4270d94e-7503-4467-b925-e6b2095afba4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1545 microversion: 2.1 time: 0.154010 Jan 31 04:57:58.266009 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 560/1109] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:58 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:58.282720 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7ffa7b86-c014-423b-a277-31451db0ce8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:58.283598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7ffa7b86-c014-423b-a277-31451db0ce8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:58.290076 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b86-c014-423b-a277-31451db0ce8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:58.290519 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b86-c014-423b-a277-31451db0ce8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:58.291324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b86-c014-423b-a277-31451db0ce8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:58.291756 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ffa7b86-c014-423b-a277-31451db0ce8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:58.426429 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-7ffa7b86-c014-423b-a277-31451db0ce8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:58.433982 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7ffa7b86-c014-423b-a277-31451db0ce8e tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1545 microversion: 2.1 time: 0.155610 Jan 31 04:57:58.434549 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 550/1110] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:58 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1545 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:57:58.455248 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:58.458569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:57:58.458569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:57:58.459569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:58.460308 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Searching by: {'deleted': False, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a'} {{(pid=123368) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 31 04:57:58.467690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:58.468148 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:58.468963 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:58.469479 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:58.563048 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.multi_cell_list [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123368) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 31 04:57:58.657349 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-9ecda7af-1148-46f7-8719-b97f9a2753fe tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206189 Jan 31 04:57:58.657839 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 561/1111] 10.222.0.21 () {58 vars in 1124 bytes} [Mon Jan 31 04:57:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:57:58.667705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-38f2ec6f-ca17-4d57-b1bc-efe88494de7c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:57:58.668319 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-38f2ec6f-ca17-4d57-b1bc-efe88494de7c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:57:58.674778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-38f2ec6f-ca17-4d57-b1bc-efe88494de7c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:58.675255 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-38f2ec6f-ca17-4d57-b1bc-efe88494de7c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:58.676043 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-38f2ec6f-ca17-4d57-b1bc-efe88494de7c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:57:58.676478 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-38f2ec6f-ca17-4d57-b1bc-efe88494de7c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:57:58.808892 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-38f2ec6f-ca17-4d57-b1bc-efe88494de7c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:57:58.817280 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-38f2ec6f-ca17-4d57-b1bc-efe88494de7c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1545 microversion: 2.1 time: 0.153207 Jan 31 04:57:58.817834 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 551/1112] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:57:58 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1545 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:00.627170 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f0f09349-ce55-42a2-924c-063d9c9d9217 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30b240ec-511c-4fa1-af69-8cb2adf6603f"}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:00.628247 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f0f09349-ce55-42a2-924c-063d9c9d9217 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:00.635796 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f0f09349-ce55-42a2-924c-063d9c9d9217 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:00.636238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f0f09349-ce55-42a2-924c-063d9c9d9217 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:00.637013 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f0f09349-ce55-42a2-924c-063d9c9d9217 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:00.637502 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f0f09349-ce55-42a2-924c-063d9c9d9217 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:01.329183 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f0f09349-ce55-42a2-924c-063d9c9d9217 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "POST /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705970 Jan 31 04:58:01.329936 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 562/1113] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Jan 31 04:58:00 2022] POST /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:58:09.892506 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b06e3bb9-25dd-4edd-b546-93fc63f56c5b tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:09.893235 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b06e3bb9-25dd-4edd-b546-93fc63f56c5b tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:09.899880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b06e3bb9-25dd-4edd-b546-93fc63f56c5b tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:09.900327 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b06e3bb9-25dd-4edd-b546-93fc63f56c5b tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:09.901114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b06e3bb9-25dd-4edd-b546-93fc63f56c5b tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:09.901544 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b06e3bb9-25dd-4edd-b546-93fc63f56c5b tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:10.033585 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b06e3bb9-25dd-4edd-b546-93fc63f56c5b tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:10.041950 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b06e3bb9-25dd-4edd-b546-93fc63f56c5b tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1591 microversion: 2.1 time: 0.153140 Jan 31 04:58:10.042515 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 552/1114] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:09 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1591 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:12.383788 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-0611c840-01f2-4f7e-9d4c-6bbd3b18cc93 req-0f9a24dd-5002-419b-b67b-d89723b24c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8e9031-6c59-42e9-9220-6a99b06a7b65", "tag": "51f5ced7-36d1-4a88-8073-6035ed00ae5d"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:12.385595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:58:12.385595 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:58:12.393386 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-0611c840-01f2-4f7e-9d4c-6bbd3b18cc93 req-0f9a24dd-5002-419b-b67b-d89723b24c64 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:12.393827 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-0611c840-01f2-4f7e-9d4c-6bbd3b18cc93 req-0f9a24dd-5002-419b-b67b-d89723b24c64 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:12.405528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-0611c840-01f2-4f7e-9d4c-6bbd3b18cc93 req-0f9a24dd-5002-419b-b67b-d89723b24c64 service nova] Creating event network-changed:51f5ced7-36d1-4a88-8073-6035ed00ae5d for instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 on hv-cinder-82660 Jan 31 04:58:12.410934 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-0611c840-01f2-4f7e-9d4c-6bbd3b18cc93 req-0f9a24dd-5002-419b-b67b-d89723b24c64 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131595 Jan 31 04:58:12.411556 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 563/1115] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:58:14.974122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5086cb42-79e3-45cb-b7fb-dcfa65cbf0db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-399267011"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:14.975705 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5086cb42-79e3-45cb-b7fb-dcfa65cbf0db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:14.981153 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5086cb42-79e3-45cb-b7fb-dcfa65cbf0db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:14.981598 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5086cb42-79e3-45cb-b7fb-dcfa65cbf0db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:14.982457 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5086cb42-79e3-45cb-b7fb-dcfa65cbf0db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:14.982912 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5086cb42-79e3-45cb-b7fb-dcfa65cbf0db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:15.115254 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.network.security_group_api [None req-5086cb42-79e3-45cb-b7fb-dcfa65cbf0db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Adding security group e5ab4f63-60f8-4f92-9330-9a10d9465caf to port 51f5ced7-36d1-4a88-8073-6035ed00ae5d Jan 31 04:58:15.551109 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5086cb42-79e3-45cb-b7fb-dcfa65cbf0db tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "POST /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/action" status: 202 len: 0 microversion: 2.1 time: 0.580654 Jan 31 04:58:15.551907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 553/1116] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:58:14 2022] POST /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:58:15.564926 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-bacb45f9-9683-4cdb-9403-53ad7e2082bd tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:15.565642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-bacb45f9-9683-4cdb-9403-53ad7e2082bd tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:15.567584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-4368fcce-a2e2-4447-bea3-ccbf755d2731 req-834af731-6f3f-4b56-9faf-d6dadb4ad5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8e9031-6c59-42e9-9220-6a99b06a7b65", "tag": "51f5ced7-36d1-4a88-8073-6035ed00ae5d"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:15.570998 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:58:15.570998 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:58:15.574026 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bacb45f9-9683-4cdb-9403-53ad7e2082bd tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:15.574471 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bacb45f9-9683-4cdb-9403-53ad7e2082bd tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:15.575317 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bacb45f9-9683-4cdb-9403-53ad7e2082bd tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:15.575753 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bacb45f9-9683-4cdb-9403-53ad7e2082bd tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:15.581451 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-4368fcce-a2e2-4447-bea3-ccbf755d2731 req-834af731-6f3f-4b56-9faf-d6dadb4ad5c3 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:15.581896 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-4368fcce-a2e2-4447-bea3-ccbf755d2731 req-834af731-6f3f-4b56-9faf-d6dadb4ad5c3 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:15.604501 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-4368fcce-a2e2-4447-bea3-ccbf755d2731 req-834af731-6f3f-4b56-9faf-d6dadb4ad5c3 service nova] Creating event network-changed:51f5ced7-36d1-4a88-8073-6035ed00ae5d for instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 on hv-cinder-82660 Jan 31 04:58:15.623655 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-4368fcce-a2e2-4447-bea3-ccbf755d2731 req-834af731-6f3f-4b56-9faf-d6dadb4ad5c3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048493 Jan 31 04:58:15.624326 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 554/1117] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:58:15.963669 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-bacb45f9-9683-4cdb-9403-53ad7e2082bd tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:15.973190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-bacb45f9-9683-4cdb-9403-53ad7e2082bd tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1756 microversion: 2.1 time: 0.416051 Jan 31 04:58:15.973758 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 564/1118] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:15 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1756 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:58:16.990627 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2eb10d4f-e6a3-450a-8d51-3246d29fd46b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:16.991359 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2eb10d4f-e6a3-450a-8d51-3246d29fd46b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:16.993265 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-d7fd9faa-b07e-4b94-b1cf-ffc6a24657ce req-cdd12512-c72f-4329-ba14-400bf5d3add3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e253ce-c129-44d9-9219-b29dd9feb759", "tag": "93af9573-d882-4ed1-ba22-f2922408b158"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:16.995375 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:58:16.995375 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:58:16.998224 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2eb10d4f-e6a3-450a-8d51-3246d29fd46b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:16.998660 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2eb10d4f-e6a3-450a-8d51-3246d29fd46b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:16.999446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2eb10d4f-e6a3-450a-8d51-3246d29fd46b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:16.999875 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2eb10d4f-e6a3-450a-8d51-3246d29fd46b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:17.002995 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-d7fd9faa-b07e-4b94-b1cf-ffc6a24657ce req-cdd12512-c72f-4329-ba14-400bf5d3add3 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:17.003507 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-d7fd9faa-b07e-4b94-b1cf-ffc6a24657ce req-cdd12512-c72f-4329-ba14-400bf5d3add3 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:17.015628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-d7fd9faa-b07e-4b94-b1cf-ffc6a24657ce req-cdd12512-c72f-4329-ba14-400bf5d3add3 service nova] Creating event network-changed:93af9573-d882-4ed1-ba22-f2922408b158 for instance 42e253ce-c129-44d9-9219-b29dd9feb759 on hv-cinder-82660 Jan 31 04:58:17.021409 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-d7fd9faa-b07e-4b94-b1cf-ffc6a24657ce req-cdd12512-c72f-4329-ba14-400bf5d3add3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032678 Jan 31 04:58:17.022238 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 565/1119] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:58:17.025555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2eb10d4f-e6a3-450a-8d51-3246d29fd46b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 04:58:17.316213 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2eb10d4f-e6a3-450a-8d51-3246d29fd46b tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "DELETE /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 204 len: 0 microversion: 2.1 time: 0.329967 Jan 31 04:58:17.317035 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 555/1120] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 04:58:16 2022] DELETE /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 04:58:17.337425 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-69daf435-e600-4a4c-ab70-f6cdc580cb3c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:17.338498 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-69daf435-e600-4a4c-ab70-f6cdc580cb3c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:17.346174 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69daf435-e600-4a4c-ab70-f6cdc580cb3c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:17.346738 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69daf435-e600-4a4c-ab70-f6cdc580cb3c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:17.347633 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69daf435-e600-4a4c-ab70-f6cdc580cb3c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:17.348389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-69daf435-e600-4a4c-ab70-f6cdc580cb3c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:17.575315 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-69daf435-e600-4a4c-ab70-f6cdc580cb3c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:17.583021 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-69daf435-e600-4a4c-ab70-f6cdc580cb3c tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1565 microversion: 2.1 time: 0.252889 Jan 31 04:58:17.584466 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 566/1121] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:17 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:18.602778 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e4a60823-5bc0-4974-b189-686110f9a8c0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:18.603531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e4a60823-5bc0-4974-b189-686110f9a8c0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:18.609696 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e4a60823-5bc0-4974-b189-686110f9a8c0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:18.610135 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e4a60823-5bc0-4974-b189-686110f9a8c0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:18.610926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e4a60823-5bc0-4974-b189-686110f9a8c0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:18.611356 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e4a60823-5bc0-4974-b189-686110f9a8c0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:18.750829 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e4a60823-5bc0-4974-b189-686110f9a8c0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:18.758247 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e4a60823-5bc0-4974-b189-686110f9a8c0 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1446 microversion: 2.1 time: 0.160075 Jan 31 04:58:18.760100 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 556/1122] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:18 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:19.776015 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2325dadc-7e8d-4f99-bb1b-4654a818941f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:19.776723 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2325dadc-7e8d-4f99-bb1b-4654a818941f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:19.783400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2325dadc-7e8d-4f99-bb1b-4654a818941f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:19.783841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2325dadc-7e8d-4f99-bb1b-4654a818941f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:19.784628 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2325dadc-7e8d-4f99-bb1b-4654a818941f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:19.785187 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2325dadc-7e8d-4f99-bb1b-4654a818941f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:20.052391 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2325dadc-7e8d-4f99-bb1b-4654a818941f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:20.060694 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2325dadc-7e8d-4f99-bb1b-4654a818941f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1446 microversion: 2.1 time: 0.288289 Jan 31 04:58:20.061257 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 567/1123] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:19 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1446 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:20.268485 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-1b1f3e49-c058-4556-96a2-39f638d38014 req-f7e14313-6b04-47f0-b468-0fdbeb17dd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e253ce-c129-44d9-9219-b29dd9feb759", "name": "network-vif-deleted", "tag": "93af9573-d882-4ed1-ba22-f2922408b158"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:20.270158 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:58:20.270158 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:58:20.278519 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-1b1f3e49-c058-4556-96a2-39f638d38014 req-f7e14313-6b04-47f0-b468-0fdbeb17dd8b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:20.279048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-1b1f3e49-c058-4556-96a2-39f638d38014 req-f7e14313-6b04-47f0-b468-0fdbeb17dd8b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:20.290113 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-1b1f3e49-c058-4556-96a2-39f638d38014 req-f7e14313-6b04-47f0-b468-0fdbeb17dd8b service nova] Creating event network-vif-deleted:93af9573-d882-4ed1-ba22-f2922408b158 for instance 42e253ce-c129-44d9-9219-b29dd9feb759 on hv-cinder-82660 Jan 31 04:58:20.295177 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-1b1f3e49-c058-4556-96a2-39f638d38014 req-f7e14313-6b04-47f0-b468-0fdbeb17dd8b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030282 Jan 31 04:58:20.295744 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 557/1124] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:58:20.581581 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-819910161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2002478922", "security_groups": [{"name": "tempest-secgroup-smoke-15449547"}], "block_device_mapping_v2": [{"uuid": "ddb19760-3a24-4b52-b720-d2ae36521b09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6fe4c16-92c7-4a31-bdef-109ade3261a7"}]}} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:20.697020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.network.neutron [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] validate_networks() for [('d6fe4c16-92c7-4a31-bdef-109ade3261a7', None, None, None, None, None)] {{(pid=123368) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 04:58:21.064550 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Flavor limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 04:58:21.065120 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Image limits 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 04:58:21.065468 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Flavor pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 04:58:21.065877 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Image pref 0:0:0 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 04:58:21.066290 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.virt.hardware [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 04:58:21.075375 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:21.075835 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:21.076641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:21.077075 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:21.078980 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:21.079676 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:21.087338 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:21.087841 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:21.088630 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:21.089061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:21.094756 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 04:58:21.099502 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.quota [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for user bcaad1042b434b5a8ff8f3a0acc585ec and project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'instances', 'cores', 'ram'} {{(pid=123368) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 04:58:21.122800 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:21.123265 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:21.123699 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lazy-loading 'fault' on Instance uuid 42e253ce-c129-44d9-9219-b29dd9feb759 {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 04:58:21.157220 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Going to run 1 instances... {{(pid=123368) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 04:58:21.159457 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddb19760-3a24-4b52-b720-d2ae36521b09',volume_size=None,volume_type=None)] {{(pid=123368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 04:58:21.166617 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a231040d254416cb6af258aed9f9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c2584cb883458eaf6b3b04d55a9429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:21.174528 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-11ebb796-33ad-483b-b8bf-4ecf95010e11 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 200 len: 1221 microversion: 2.1 time: 0.100313 Jan 31 04:58:21.175122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 558/1125] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:21 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 1221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:21.532043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b8cba044-ccc0-495a-92e7-bfbc1900a80a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.953969 Jan 31 04:58:21.532603 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 568/1126] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 04:58:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 04:58:21.545298 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-60c8b64d-e275-4b98-8206-9964e2007175 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:21.545912 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-60c8b64d-e275-4b98-8206-9964e2007175 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:21.602074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-60c8b64d-e275-4b98-8206-9964e2007175 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:21.609781 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-60c8b64d-e275-4b98-8206-9964e2007175 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1094 microversion: 2.1 time: 0.068257 Jan 31 04:58:21.610348 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 559/1127] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:21 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:22.204748 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:22.205573 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] [instance: 42e253ce-c129-44d9-9219-b29dd9feb759] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:22.211484 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:22.211959 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:22.212702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:22.213145 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:22.228130 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] HTTP exception thrown: Instance 42e253ce-c129-44d9-9219-b29dd9feb759 could not be found. Jan 31 04:58:22.228733 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Returning 404 to user: Instance 42e253ce-c129-44d9-9219-b29dd9feb759 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 04:58:22.229546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-085739ce-c001-4f3d-b353-30d751c27f6f tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759" status: 404 len: 111 microversion: 2.1 time: 0.028893 Jan 31 04:58:22.233144 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 569/1128] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:22 2022] GET /compute/v2.1/servers/42e253ce-c129-44d9-9219-b29dd9feb759 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 04:58:22.442968 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c11c12e1-f6ec-48a8-846b-7c2ae0092666 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] Calling method '.version_select at 0x7f69f55d6310>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:22.508105 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c11c12e1-f6ec-48a8-846b-7c2ae0092666 tempest-TestShelveInstance-22980575 tempest-TestShelveInstance-22980575-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-29663173" status: 202 len: 0 microversion: 2.1 time: 0.068946 Jan 31 04:58:22.508680 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 560/1129] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Jan 31 04:58:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-29663173 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:58:22.627055 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1bf8499a-8add-477d-b506-e21ea157411e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:22.627677 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1bf8499a-8add-477d-b506-e21ea157411e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:22.634059 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1bf8499a-8add-477d-b506-e21ea157411e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:22.634637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1bf8499a-8add-477d-b506-e21ea157411e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:22.635537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1bf8499a-8add-477d-b506-e21ea157411e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:22.635968 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1bf8499a-8add-477d-b506-e21ea157411e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:22.709593 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1bf8499a-8add-477d-b506-e21ea157411e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:22.717178 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1bf8499a-8add-477d-b506-e21ea157411e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1144 microversion: 2.1 time: 0.093941 Jan 31 04:58:22.717680 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 570/1130] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:22 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:23.734168 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-82a32887-9631-43cd-82de-44711425104b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:23.735736 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-82a32887-9631-43cd-82de-44711425104b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:23.750358 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82a32887-9631-43cd-82de-44711425104b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:23.750855 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82a32887-9631-43cd-82de-44711425104b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:23.751638 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82a32887-9631-43cd-82de-44711425104b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:23.752074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82a32887-9631-43cd-82de-44711425104b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:23.850692 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-82a32887-9631-43cd-82de-44711425104b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:23.858743 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-82a32887-9631-43cd-82de-44711425104b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1200 microversion: 2.1 time: 0.128646 Jan 31 04:58:23.862479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 561/1131] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:23 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1200 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:24.875641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-afb776fe-1eec-4e72-a93d-6cf89659f683 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:24.876251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-afb776fe-1eec-4e72-a93d-6cf89659f683 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:24.883501 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-afb776fe-1eec-4e72-a93d-6cf89659f683 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:24.884245 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-afb776fe-1eec-4e72-a93d-6cf89659f683 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:24.885020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-afb776fe-1eec-4e72-a93d-6cf89659f683 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:24.885455 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-afb776fe-1eec-4e72-a93d-6cf89659f683 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:25.056977 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-afb776fe-1eec-4e72-a93d-6cf89659f683 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:25.064632 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-afb776fe-1eec-4e72-a93d-6cf89659f683 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1276 microversion: 2.1 time: 0.192535 Jan 31 04:58:25.067959 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 571/1132] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:24 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:25.457025 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-2d16ae5d-feed-4ec9-bae6-2a68a03cc653 req-f814871b-66b2-4987-ba5d-5b8e978faa2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136c717e-248a-4393-9e3b-4703b87f5ddb", "tag": "82a03e5c-3cf4-4891-b8cf-e1bb55979dba"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:25.459516 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:58:25.459516 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 04:58:25.473704 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-2d16ae5d-feed-4ec9-bae6-2a68a03cc653 req-f814871b-66b2-4987-ba5d-5b8e978faa2b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:25.474154 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-2d16ae5d-feed-4ec9-bae6-2a68a03cc653 req-f814871b-66b2-4987-ba5d-5b8e978faa2b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:25.485981 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-2d16ae5d-feed-4ec9-bae6-2a68a03cc653 req-f814871b-66b2-4987-ba5d-5b8e978faa2b service nova] Creating event network-changed:82a03e5c-3cf4-4891-b8cf-e1bb55979dba for instance 136c717e-248a-4393-9e3b-4703b87f5ddb on hv-cinder-82660 Jan 31 04:58:25.501829 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-2d16ae5d-feed-4ec9-bae6-2a68a03cc653 req-f814871b-66b2-4987-ba5d-5b8e978faa2b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051668 Jan 31 04:58:25.502745 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 562/1133] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 04:58:26.086078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-3cb1060b-19dc-4162-b393-cf7924688562 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:26.086960 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-3cb1060b-19dc-4162-b393-cf7924688562 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:26.097832 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3cb1060b-19dc-4162-b393-cf7924688562 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:26.098334 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3cb1060b-19dc-4162-b393-cf7924688562 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:26.099149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3cb1060b-19dc-4162-b393-cf7924688562 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:26.100153 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-3cb1060b-19dc-4162-b393-cf7924688562 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:26.381169 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-3cb1060b-19dc-4162-b393-cf7924688562 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:26.391309 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-3cb1060b-19dc-4162-b393-cf7924688562 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.309754 Jan 31 04:58:26.402772 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 572/1134] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:26 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:27.409476 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-26626c86-4fbc-40f7-a3ba-0ef9d91162a9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:27.410165 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-26626c86-4fbc-40f7-a3ba-0ef9d91162a9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:27.416656 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-26626c86-4fbc-40f7-a3ba-0ef9d91162a9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:27.417095 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-26626c86-4fbc-40f7-a3ba-0ef9d91162a9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:27.417864 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-26626c86-4fbc-40f7-a3ba-0ef9d91162a9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:27.418291 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-26626c86-4fbc-40f7-a3ba-0ef9d91162a9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:27.571924 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-26626c86-4fbc-40f7-a3ba-0ef9d91162a9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:27.579599 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-26626c86-4fbc-40f7-a3ba-0ef9d91162a9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.174070 Jan 31 04:58:27.580170 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 563/1135] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:27 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:28.600482 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-af4e7c81-a13e-4ff7-8149-0712b051e965 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:28.601782 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-af4e7c81-a13e-4ff7-8149-0712b051e965 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:28.614929 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af4e7c81-a13e-4ff7-8149-0712b051e965 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:28.616289 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af4e7c81-a13e-4ff7-8149-0712b051e965 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:28.617319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af4e7c81-a13e-4ff7-8149-0712b051e965 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:28.618700 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-af4e7c81-a13e-4ff7-8149-0712b051e965 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:28.809177 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-af4e7c81-a13e-4ff7-8149-0712b051e965 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:28.816337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-af4e7c81-a13e-4ff7-8149-0712b051e965 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.222450 Jan 31 04:58:28.816898 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 573/1136] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:28 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:29.835934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2179c33c-2ecc-483c-9eed-2bd5042d2070 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:29.836487 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2179c33c-2ecc-483c-9eed-2bd5042d2070 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:29.844416 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2179c33c-2ecc-483c-9eed-2bd5042d2070 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:29.845097 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2179c33c-2ecc-483c-9eed-2bd5042d2070 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:29.845961 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2179c33c-2ecc-483c-9eed-2bd5042d2070 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:29.846400 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2179c33c-2ecc-483c-9eed-2bd5042d2070 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:30.071763 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2179c33c-2ecc-483c-9eed-2bd5042d2070 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:30.079872 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2179c33c-2ecc-483c-9eed-2bd5042d2070 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.249896 Jan 31 04:58:30.090838 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 564/1137] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:29 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:31.096889 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-e97d75e4-3022-4509-a5b3-30092d51dc5a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:31.097500 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-e97d75e4-3022-4509-a5b3-30092d51dc5a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:31.104217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e97d75e4-3022-4509-a5b3-30092d51dc5a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:31.104869 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e97d75e4-3022-4509-a5b3-30092d51dc5a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:31.106021 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e97d75e4-3022-4509-a5b3-30092d51dc5a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:31.106776 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-e97d75e4-3022-4509-a5b3-30092d51dc5a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:31.243560 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-e97d75e4-3022-4509-a5b3-30092d51dc5a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:31.251043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-e97d75e4-3022-4509-a5b3-30092d51dc5a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.157681 Jan 31 04:58:31.251607 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 574/1138] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:31 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:32.268767 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b67e2988-68ba-4175-bcbe-47b9ca4a5f81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:32.269499 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b67e2988-68ba-4175-bcbe-47b9ca4a5f81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:32.276479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b67e2988-68ba-4175-bcbe-47b9ca4a5f81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:32.276934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b67e2988-68ba-4175-bcbe-47b9ca4a5f81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:32.277729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b67e2988-68ba-4175-bcbe-47b9ca4a5f81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:32.278168 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b67e2988-68ba-4175-bcbe-47b9ca4a5f81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:32.418336 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b67e2988-68ba-4175-bcbe-47b9ca4a5f81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:32.425530 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b67e2988-68ba-4175-bcbe-47b9ca4a5f81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.160609 Jan 31 04:58:32.426088 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 565/1139] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:32 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:33.443312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5e71e352-dbae-4749-9b4e-c6006ccd9a9d tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:33.443856 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5e71e352-dbae-4749-9b4e-c6006ccd9a9d tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:33.450164 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5e71e352-dbae-4749-9b4e-c6006ccd9a9d tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:33.450607 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5e71e352-dbae-4749-9b4e-c6006ccd9a9d tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:33.451403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5e71e352-dbae-4749-9b4e-c6006ccd9a9d tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:33.451845 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5e71e352-dbae-4749-9b4e-c6006ccd9a9d tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:33.588741 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5e71e352-dbae-4749-9b4e-c6006ccd9a9d tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:33.596164 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5e71e352-dbae-4749-9b4e-c6006ccd9a9d tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.157031 Jan 31 04:58:33.596931 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 575/1140] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:33 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:34.613588 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-82d7bea1-a03e-47e7-bfe6-6ef24cf2145c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:34.615007 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-82d7bea1-a03e-47e7-bfe6-6ef24cf2145c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:34.621613 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82d7bea1-a03e-47e7-bfe6-6ef24cf2145c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:34.622104 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82d7bea1-a03e-47e7-bfe6-6ef24cf2145c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:34.622923 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82d7bea1-a03e-47e7-bfe6-6ef24cf2145c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:34.623354 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-82d7bea1-a03e-47e7-bfe6-6ef24cf2145c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:34.763222 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-82d7bea1-a03e-47e7-bfe6-6ef24cf2145c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:34.771185 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-82d7bea1-a03e-47e7-bfe6-6ef24cf2145c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.160707 Jan 31 04:58:34.771747 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 566/1141] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:34 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:35.788337 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a74286ca-1807-425a-8523-9ead7a9d63c5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:35.788949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a74286ca-1807-425a-8523-9ead7a9d63c5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:35.795330 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a74286ca-1807-425a-8523-9ead7a9d63c5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:35.795785 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a74286ca-1807-425a-8523-9ead7a9d63c5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:35.796586 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a74286ca-1807-425a-8523-9ead7a9d63c5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:35.797020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a74286ca-1807-425a-8523-9ead7a9d63c5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:35.933601 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a74286ca-1807-425a-8523-9ead7a9d63c5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:35.941162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a74286ca-1807-425a-8523-9ead7a9d63c5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.157055 Jan 31 04:58:35.941732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 576/1142] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:35 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:36.958528 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-14098bd3-452c-4138-aa59-74400ff11ca4 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:36.959154 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-14098bd3-452c-4138-aa59-74400ff11ca4 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:36.965592 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-14098bd3-452c-4138-aa59-74400ff11ca4 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:36.966139 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-14098bd3-452c-4138-aa59-74400ff11ca4 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:36.966999 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-14098bd3-452c-4138-aa59-74400ff11ca4 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:36.967450 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-14098bd3-452c-4138-aa59-74400ff11ca4 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:37.104537 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-14098bd3-452c-4138-aa59-74400ff11ca4 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:37.111804 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-14098bd3-452c-4138-aa59-74400ff11ca4 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.158243 Jan 31 04:58:37.113649 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 567/1143] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:36 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:37.179644 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-7716d6f5-5493-4c9c-b6fe-adc60baeb03b req-79ba6e3f-f755-4880-983c-f95ef9b619e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136c717e-248a-4393-9e3b-4703b87f5ddb", "name": "network-vif-plugged", "status": "completed", "tag": "82a03e5c-3cf4-4891-b8cf-e1bb55979dba"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:37.181269 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:58:37.181269 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:58:37.188508 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-7716d6f5-5493-4c9c-b6fe-adc60baeb03b req-79ba6e3f-f755-4880-983c-f95ef9b619e4 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:37.188941 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-7716d6f5-5493-4c9c-b6fe-adc60baeb03b req-79ba6e3f-f755-4880-983c-f95ef9b619e4 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:37.199388 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-7716d6f5-5493-4c9c-b6fe-adc60baeb03b req-79ba6e3f-f755-4880-983c-f95ef9b619e4 service nova] Creating event network-vif-plugged:82a03e5c-3cf4-4891-b8cf-e1bb55979dba for instance 136c717e-248a-4393-9e3b-4703b87f5ddb on hv-cinder-82660 Jan 31 04:58:37.204273 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-7716d6f5-5493-4c9c-b6fe-adc60baeb03b req-79ba6e3f-f755-4880-983c-f95ef9b619e4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028680 Jan 31 04:58:37.204834 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 577/1144] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:58:38.128260 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-8309f4c0-4820-46cf-bb56-33cf2c0a6b8c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:38.128870 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-8309f4c0-4820-46cf-bb56-33cf2c0a6b8c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:38.135140 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8309f4c0-4820-46cf-bb56-33cf2c0a6b8c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:38.135583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8309f4c0-4820-46cf-bb56-33cf2c0a6b8c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:38.136353 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8309f4c0-4820-46cf-bb56-33cf2c0a6b8c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:38.136785 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-8309f4c0-4820-46cf-bb56-33cf2c0a6b8c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:38.269508 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-8309f4c0-4820-46cf-bb56-33cf2c0a6b8c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:38.277238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-8309f4c0-4820-46cf-bb56-33cf2c0a6b8c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1264 microversion: 2.1 time: 0.152565 Jan 31 04:58:38.277791 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 568/1145] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:38 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:39.295285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6b98efe5-b52e-4ca3-8c5c-2f6a14403911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:39.295978 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6b98efe5-b52e-4ca3-8c5c-2f6a14403911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:39.302518 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6b98efe5-b52e-4ca3-8c5c-2f6a14403911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:39.305751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6b98efe5-b52e-4ca3-8c5c-2f6a14403911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:39.305751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6b98efe5-b52e-4ca3-8c5c-2f6a14403911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:39.305751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6b98efe5-b52e-4ca3-8c5c-2f6a14403911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:39.438882 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-6b98efe5-b52e-4ca3-8c5c-2f6a14403911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:39.447244 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6b98efe5-b52e-4ca3-8c5c-2f6a14403911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1450 microversion: 2.1 time: 0.156403 Jan 31 04:58:39.447812 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 578/1146] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:39 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:58:39.463178 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-9a3ac3ce-c84e-45a0-ae0a-d7833fcf4911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:58:39.463785 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-9a3ac3ce-c84e-45a0-ae0a-d7833fcf4911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:58:39.470003 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a3ac3ce-c84e-45a0-ae0a-d7833fcf4911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:39.470446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a3ac3ce-c84e-45a0-ae0a-d7833fcf4911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:39.471249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a3ac3ce-c84e-45a0-ae0a-d7833fcf4911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:39.471681 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-9a3ac3ce-c84e-45a0-ae0a-d7833fcf4911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:39.609121 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-9a3ac3ce-c84e-45a0-ae0a-d7833fcf4911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:58:39.616947 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-9a3ac3ce-c84e-45a0-ae0a-d7833fcf4911 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1450 microversion: 2.1 time: 0.157495 Jan 31 04:58:39.617741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 569/1147] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:58:39 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 04:58:41.921088 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-2ffa4c44-b411-401d-b63e-140d45cb91cd req-e7fe5a40-5965-4c03-9562-a00b4f98934f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136c717e-248a-4393-9e3b-4703b87f5ddb", "tag": "82a03e5c-3cf4-4891-b8cf-e1bb55979dba"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:58:41.922896 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:58:41.922896 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 04:58:41.930696 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-2ffa4c44-b411-401d-b63e-140d45cb91cd req-e7fe5a40-5965-4c03-9562-a00b4f98934f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:58:41.931170 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-2ffa4c44-b411-401d-b63e-140d45cb91cd req-e7fe5a40-5965-4c03-9562-a00b4f98934f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:58:41.943391 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-2ffa4c44-b411-401d-b63e-140d45cb91cd req-e7fe5a40-5965-4c03-9562-a00b4f98934f service nova] Creating event network-changed:82a03e5c-3cf4-4891-b8cf-e1bb55979dba for instance 136c717e-248a-4393-9e3b-4703b87f5ddb on hv-cinder-82660 Jan 31 04:58:41.948310 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-2ffa4c44-b411-401d-b63e-140d45cb91cd req-e7fe5a40-5965-4c03-9562-a00b4f98934f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030953 Jan 31 04:58:41.949186 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 579/1148] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 04:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 04:58:46.896061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 04:58:46.896906 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: Mon Jan 31 04:58:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 04:58:52.965206 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 04:58:52.965743 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 04:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 04:59:14.577156 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-fde9cd3f-29e0-42b8-bd0f-6465347c6f07 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 04:59:14.578230 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-fde9cd3f-29e0-42b8-bd0f-6465347c6f07 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:14.584048 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fde9cd3f-29e0-42b8-bd0f-6465347c6f07 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:14.584493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fde9cd3f-29e0-42b8-bd0f-6465347c6f07 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:14.585962 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fde9cd3f-29e0-42b8-bd0f-6465347c6f07 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:14.586398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fde9cd3f-29e0-42b8-bd0f-6465347c6f07 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:14.749854 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-fde9cd3f-29e0-42b8-bd0f-6465347c6f07 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "POST /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/action" status: 202 len: 0 microversion: 2.1 time: 0.176378 Jan 31 04:59:14.750659 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 570/1149] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 04:59:14 2022] POST /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 04:59:14.759818 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-779ac071-c55d-4a5b-be9d-dcaa44c25ffb tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:14.760510 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-779ac071-c55d-4a5b-be9d-dcaa44c25ffb tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:14.766383 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-779ac071-c55d-4a5b-be9d-dcaa44c25ffb tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:14.766905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-779ac071-c55d-4a5b-be9d-dcaa44c25ffb tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:14.767673 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-779ac071-c55d-4a5b-be9d-dcaa44c25ffb tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:14.768101 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-779ac071-c55d-4a5b-be9d-dcaa44c25ffb tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:14.914282 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-779ac071-c55d-4a5b-be9d-dcaa44c25ffb tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:14.922023 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-779ac071-c55d-4a5b-be9d-dcaa44c25ffb tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1748 microversion: 2.1 time: 0.167078 Jan 31 04:59:14.922585 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 580/1150] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:14 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:15.940932 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-0d877785-4c00-41bc-84d5-51e8e8264360 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:15.941624 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-0d877785-4c00-41bc-84d5-51e8e8264360 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:15.948242 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0d877785-4c00-41bc-84d5-51e8e8264360 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:15.948684 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0d877785-4c00-41bc-84d5-51e8e8264360 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:15.949448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0d877785-4c00-41bc-84d5-51e8e8264360 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:15.949884 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-0d877785-4c00-41bc-84d5-51e8e8264360 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:16.090741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-0d877785-4c00-41bc-84d5-51e8e8264360 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:16.098491 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-0d877785-4c00-41bc-84d5-51e8e8264360 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.162050 Jan 31 04:59:16.099085 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 571/1151] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:15 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:17.114865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-94eaab30-4eaf-4a56-8239-443295e53ae5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:17.115475 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-94eaab30-4eaf-4a56-8239-443295e53ae5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:17.122393 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-94eaab30-4eaf-4a56-8239-443295e53ae5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:17.122860 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-94eaab30-4eaf-4a56-8239-443295e53ae5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:17.123627 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-94eaab30-4eaf-4a56-8239-443295e53ae5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:17.124059 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-94eaab30-4eaf-4a56-8239-443295e53ae5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:17.269592 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-94eaab30-4eaf-4a56-8239-443295e53ae5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:17.277865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-94eaab30-4eaf-4a56-8239-443295e53ae5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.166600 Jan 31 04:59:17.278416 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 581/1152] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:17 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:18.294454 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-fc1023fa-e366-4a73-a6d5-a86888921ed4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:18.295090 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-fc1023fa-e366-4a73-a6d5-a86888921ed4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:18.301299 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fc1023fa-e366-4a73-a6d5-a86888921ed4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:18.301738 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fc1023fa-e366-4a73-a6d5-a86888921ed4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:18.302530 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fc1023fa-e366-4a73-a6d5-a86888921ed4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:18.302993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fc1023fa-e366-4a73-a6d5-a86888921ed4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:18.447183 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-fc1023fa-e366-4a73-a6d5-a86888921ed4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:18.454733 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-fc1023fa-e366-4a73-a6d5-a86888921ed4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.163949 Jan 31 04:59:18.455310 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 572/1153] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:18 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:19.471537 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-ab067a5e-1ff6-4974-aa04-10de79a7601d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:19.472127 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-ab067a5e-1ff6-4974-aa04-10de79a7601d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:19.478522 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ab067a5e-1ff6-4974-aa04-10de79a7601d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:19.479011 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ab067a5e-1ff6-4974-aa04-10de79a7601d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:19.479780 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ab067a5e-1ff6-4974-aa04-10de79a7601d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:19.480213 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-ab067a5e-1ff6-4974-aa04-10de79a7601d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:19.624533 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-ab067a5e-1ff6-4974-aa04-10de79a7601d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:19.632987 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-ab067a5e-1ff6-4974-aa04-10de79a7601d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.164915 Jan 31 04:59:19.633546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 582/1154] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:19 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:20.650209 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a76a80c3-35ad-4e18-88a4-b21f9439d899 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:20.650826 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a76a80c3-35ad-4e18-88a4-b21f9439d899 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:20.657068 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a76a80c3-35ad-4e18-88a4-b21f9439d899 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:20.657511 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a76a80c3-35ad-4e18-88a4-b21f9439d899 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:20.658270 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a76a80c3-35ad-4e18-88a4-b21f9439d899 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:20.658700 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a76a80c3-35ad-4e18-88a4-b21f9439d899 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:20.799712 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a76a80c3-35ad-4e18-88a4-b21f9439d899 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:20.807566 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a76a80c3-35ad-4e18-88a4-b21f9439d899 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.161726 Jan 31 04:59:20.808129 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 573/1155] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:20 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:21.825940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-550903c6-7888-420d-89b8-50ce09a8b3ff tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:21.826541 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-550903c6-7888-420d-89b8-50ce09a8b3ff tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:21.832790 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-550903c6-7888-420d-89b8-50ce09a8b3ff tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:21.833226 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-550903c6-7888-420d-89b8-50ce09a8b3ff tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:21.833981 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-550903c6-7888-420d-89b8-50ce09a8b3ff tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:21.834406 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-550903c6-7888-420d-89b8-50ce09a8b3ff tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:21.974001 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-550903c6-7888-420d-89b8-50ce09a8b3ff tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:21.982205 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-550903c6-7888-420d-89b8-50ce09a8b3ff tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.159833 Jan 31 04:59:21.982751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 583/1156] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:21 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:22.999187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-87e028bd-c3ff-4090-9823-1acc4f1118f5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:22.999803 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-87e028bd-c3ff-4090-9823-1acc4f1118f5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:23.006072 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-87e028bd-c3ff-4090-9823-1acc4f1118f5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:23.007055 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-87e028bd-c3ff-4090-9823-1acc4f1118f5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:23.007831 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-87e028bd-c3ff-4090-9823-1acc4f1118f5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:23.008266 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-87e028bd-c3ff-4090-9823-1acc4f1118f5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:23.153361 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-87e028bd-c3ff-4090-9823-1acc4f1118f5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:23.161011 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-87e028bd-c3ff-4090-9823-1acc4f1118f5 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.165442 Jan 31 04:59:23.161569 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 574/1157] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:22 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:24.177779 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4a06c306-0ee9-4a70-8d49-97997a836dce tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:24.178421 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4a06c306-0ee9-4a70-8d49-97997a836dce tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:24.184793 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4a06c306-0ee9-4a70-8d49-97997a836dce tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:24.185262 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4a06c306-0ee9-4a70-8d49-97997a836dce tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:24.186033 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4a06c306-0ee9-4a70-8d49-97997a836dce tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:24.186470 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4a06c306-0ee9-4a70-8d49-97997a836dce tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:24.331212 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4a06c306-0ee9-4a70-8d49-97997a836dce tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:24.339535 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4a06c306-0ee9-4a70-8d49-97997a836dce tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.165301 Jan 31 04:59:24.340033 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 584/1158] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:24 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:25.356526 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-273d21df-f1cc-4112-a786-f55c572e4d37 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:25.357092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-273d21df-f1cc-4112-a786-f55c572e4d37 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:25.363285 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-273d21df-f1cc-4112-a786-f55c572e4d37 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:25.363729 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-273d21df-f1cc-4112-a786-f55c572e4d37 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:25.364493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-273d21df-f1cc-4112-a786-f55c572e4d37 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:25.364926 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-273d21df-f1cc-4112-a786-f55c572e4d37 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:25.504000 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-273d21df-f1cc-4112-a786-f55c572e4d37 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:25.511838 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-273d21df-f1cc-4112-a786-f55c572e4d37 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1753 microversion: 2.1 time: 0.159014 Jan 31 04:59:25.512391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 575/1159] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:25 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 04:59:26.528060 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-46a060ec-6d7c-48f6-b8d1-6ebebaba82f7 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 04:59:26.528676 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-46a060ec-6d7c-48f6-b8d1-6ebebaba82f7 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 04:59:26.534985 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-46a060ec-6d7c-48f6-b8d1-6ebebaba82f7 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:26.535431 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-46a060ec-6d7c-48f6-b8d1-6ebebaba82f7 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:26.536213 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-46a060ec-6d7c-48f6-b8d1-6ebebaba82f7 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 04:59:26.536649 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-46a060ec-6d7c-48f6-b8d1-6ebebaba82f7 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 04:59:26.686372 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-46a060ec-6d7c-48f6-b8d1-6ebebaba82f7 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 04:59:26.694608 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-46a060ec-6d7c-48f6-b8d1-6ebebaba82f7 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1756 microversion: 2.1 time: 0.169597 Jan 31 04:59:26.695217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 585/1160] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 04:59:26 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:00:30.060702 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-3692bf23-7a1d-48b5-a0ef-4fa760f9e1ed tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-399267011"}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:00:30.061268 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-3692bf23-7a1d-48b5-a0ef-4fa760f9e1ed tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:30.066923 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3692bf23-7a1d-48b5-a0ef-4fa760f9e1ed tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:30.067362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3692bf23-7a1d-48b5-a0ef-4fa760f9e1ed tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:30.068121 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3692bf23-7a1d-48b5-a0ef-4fa760f9e1ed tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:30.068548 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-3692bf23-7a1d-48b5-a0ef-4fa760f9e1ed tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:30.201727 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.network.security_group_api [None req-3692bf23-7a1d-48b5-a0ef-4fa760f9e1ed tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Removing security group e5ab4f63-60f8-4f92-9330-9a10d9465caf from port 51f5ced7-36d1-4a88-8073-6035ed00ae5d Jan 31 05:00:30.577623 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-3692bf23-7a1d-48b5-a0ef-4fa760f9e1ed tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "POST /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/action" status: 202 len: 0 microversion: 2.1 time: 0.521873 Jan 31 05:00:30.581143 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 576/1161] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Jan 31 05:00:30 2022] POST /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 05:00:30.587154 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-deab372b-57f8-43a5-93ad-030732c95075 req-469a0eb7-8f08-425a-9eb4-b7ab3b27d5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8e9031-6c59-42e9-9220-6a99b06a7b65", "tag": "51f5ced7-36d1-4a88-8073-6035ed00ae5d"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:00:30.588702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:00:30.588702 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 05:00:30.595840 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-deab372b-57f8-43a5-93ad-030732c95075 req-469a0eb7-8f08-425a-9eb4-b7ab3b27d5f0 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:30.596536 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-deab372b-57f8-43a5-93ad-030732c95075 req-469a0eb7-8f08-425a-9eb4-b7ab3b27d5f0 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:30.631324 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-deab372b-57f8-43a5-93ad-030732c95075 req-469a0eb7-8f08-425a-9eb4-b7ab3b27d5f0 service nova] Creating event network-changed:51f5ced7-36d1-4a88-8073-6035ed00ae5d for instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 on hv-cinder-82660 Jan 31 05:00:30.637712 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-deab372b-57f8-43a5-93ad-030732c95075 req-469a0eb7-8f08-425a-9eb4-b7ab3b27d5f0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055599 Jan 31 05:00:30.639204 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 586/1162] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:00:32.017545 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-7ea4e9d7-000c-478d-b11f-6a86fc90820d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:32.018074 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-7ea4e9d7-000c-478d-b11f-6a86fc90820d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:32.024187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ea4e9d7-000c-478d-b11f-6a86fc90820d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:32.024633 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ea4e9d7-000c-478d-b11f-6a86fc90820d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:32.025437 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ea4e9d7-000c-478d-b11f-6a86fc90820d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:32.025871 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-7ea4e9d7-000c-478d-b11f-6a86fc90820d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:32.105955 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-7ea4e9d7-000c-478d-b11f-6a86fc90820d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lazy-loading 'services' on Instance uuid 6e8e9031-6c59-42e9-9220-6a99b06a7b65 {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 05:00:32.395783 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-7ea4e9d7-000c-478d-b11f-6a86fc90820d tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments/30b240ec-511c-4fa1-af69-8cb2adf6603f" status: 202 len: 0 microversion: 2.1 time: 0.382373 Jan 31 05:00:32.396395 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 577/1163] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 05:00:32 2022] DELETE /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments/30b240ec-511c-4fa1-af69-8cb2adf6603f => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 05:00:32.405850 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-6275134a-ec6d-439a-bb82-72c56e08fb65 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:32.410375 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-6275134a-ec6d-439a-bb82-72c56e08fb65 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:32.414598 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6275134a-ec6d-439a-bb82-72c56e08fb65 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:32.415069 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6275134a-ec6d-439a-bb82-72c56e08fb65 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:32.415856 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6275134a-ec6d-439a-bb82-72c56e08fb65 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:32.416287 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-6275134a-ec6d-439a-bb82-72c56e08fb65 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:32.444841 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-6275134a-ec6d-439a-bb82-72c56e08fb65 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043135 Jan 31 05:00:32.445878 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 587/1164] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 05:00:32 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:00:32.672987 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-34f1e98c-9eff-47da-b6c1-f68560d231bc req-d227e4c7-bd4b-4540-a4fe-4869693f99c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8e9031-6c59-42e9-9220-6a99b06a7b65", "tag": "51f5ced7-36d1-4a88-8073-6035ed00ae5d"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:00:32.675047 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:00:32.675047 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 05:00:32.682820 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-34f1e98c-9eff-47da-b6c1-f68560d231bc req-d227e4c7-bd4b-4540-a4fe-4869693f99c6 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:32.683435 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-34f1e98c-9eff-47da-b6c1-f68560d231bc req-d227e4c7-bd4b-4540-a4fe-4869693f99c6 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:32.696426 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-34f1e98c-9eff-47da-b6c1-f68560d231bc req-d227e4c7-bd4b-4540-a4fe-4869693f99c6 service nova] Creating event network-changed:51f5ced7-36d1-4a88-8073-6035ed00ae5d for instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 on hv-cinder-82660 Jan 31 05:00:32.701196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-34f1e98c-9eff-47da-b6c1-f68560d231bc req-d227e4c7-bd4b-4540-a4fe-4869693f99c6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034272 Jan 31 05:00:32.701801 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 578/1165] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:00:33.457239 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-40aae5f8-6972-42d9-aa4a-5bbf6fcc5893 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:33.458043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-40aae5f8-6972-42d9-aa4a-5bbf6fcc5893 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:33.464993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-40aae5f8-6972-42d9-aa4a-5bbf6fcc5893 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:33.465436 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-40aae5f8-6972-42d9-aa4a-5bbf6fcc5893 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:33.466194 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-40aae5f8-6972-42d9-aa4a-5bbf6fcc5893 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:33.466614 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-40aae5f8-6972-42d9-aa4a-5bbf6fcc5893 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:33.494350 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-40aae5f8-6972-42d9-aa4a-5bbf6fcc5893 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040999 Jan 31 05:00:33.495114 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 588/1166] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 05:00:33 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:00:34.506671 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b261874e-dd03-4593-b28d-eb61feff6359 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:34.508498 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b261874e-dd03-4593-b28d-eb61feff6359 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:34.514454 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b261874e-dd03-4593-b28d-eb61feff6359 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:34.514928 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b261874e-dd03-4593-b28d-eb61feff6359 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:34.515731 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b261874e-dd03-4593-b28d-eb61feff6359 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:34.516181 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b261874e-dd03-4593-b28d-eb61feff6359 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:34.544820 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b261874e-dd03-4593-b28d-eb61feff6359 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042665 Jan 31 05:00:34.545362 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 579/1167] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Jan 31 05:00:34 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 05:00:34.555791 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:34.556323 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:34.562440 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:34.562921 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:34.563689 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:34.564120 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:34.837303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] HTTP exception thrown: Instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 is not attached to volume 30b240ec-511c-4fa1-af69-8cb2adf6603f Jan 31 05:00:34.837903 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Returning 404 to user: Instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 is not attached to volume 30b240ec-511c-4fa1-af69-8cb2adf6603f {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 05:00:34.838732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7227d2ad-cf68-4348-bddb-1e4133f2707a tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments/30b240ec-511c-4fa1-af69-8cb2adf6603f" status: 404 len: 154 microversion: 2.1 time: 0.287802 Jan 31 05:00:34.839303 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 589/1168] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Jan 31 05:00:34 2022] DELETE /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65/os-volume_attachments/30b240ec-511c-4fa1-af69-8cb2adf6603f => generated 154 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 05:00:36.081287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ff6c1bba-ba4c-45d2-a32f-b09eb145baf4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:36.081774 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ff6c1bba-ba4c-45d2-a32f-b09eb145baf4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:36.088599 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ff6c1bba-ba4c-45d2-a32f-b09eb145baf4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:36.089040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ff6c1bba-ba4c-45d2-a32f-b09eb145baf4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:36.089811 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ff6c1bba-ba4c-45d2-a32f-b09eb145baf4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:36.090238 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ff6c1bba-ba4c-45d2-a32f-b09eb145baf4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:36.114938 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ff6c1bba-ba4c-45d2-a32f-b09eb145baf4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 05:00:36.501905 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ff6c1bba-ba4c-45d2-a32f-b09eb145baf4 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 204 len: 0 microversion: 2.1 time: 0.423905 Jan 31 05:00:36.502495 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 580/1169] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 05:00:36 2022] DELETE /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 05:00:36.511104 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-09cf6dcb-5768-42d2-adf1-6336eb95e2f0 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:36.511721 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-09cf6dcb-5768-42d2-adf1-6336eb95e2f0 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:36.518058 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-09cf6dcb-5768-42d2-adf1-6336eb95e2f0 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:36.518539 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-09cf6dcb-5768-42d2-adf1-6336eb95e2f0 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:36.519354 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-09cf6dcb-5768-42d2-adf1-6336eb95e2f0 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:36.525629 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-09cf6dcb-5768-42d2-adf1-6336eb95e2f0 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:36.654950 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-09cf6dcb-5768-42d2-adf1-6336eb95e2f0 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:00:36.661189 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-09cf6dcb-5768-42d2-adf1-6336eb95e2f0 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1551 microversion: 2.1 time: 0.154227 Jan 31 05:00:36.661744 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 590/1170] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:00:36 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:00:37.680135 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4cba69a4-65a4-4711-92d0-b0828bed21f8 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:37.680829 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4cba69a4-65a4-4711-92d0-b0828bed21f8 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:37.687169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4cba69a4-65a4-4711-92d0-b0828bed21f8 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:37.687659 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4cba69a4-65a4-4711-92d0-b0828bed21f8 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:37.688447 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4cba69a4-65a4-4711-92d0-b0828bed21f8 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:37.688868 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4cba69a4-65a4-4711-92d0-b0828bed21f8 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:37.821813 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4cba69a4-65a4-4711-92d0-b0828bed21f8 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:00:37.829033 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4cba69a4-65a4-4711-92d0-b0828bed21f8 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1551 microversion: 2.1 time: 0.153418 Jan 31 05:00:37.829585 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 581/1171] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:00:37 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:00:38.845356 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-bf595000-6c33-4bb8-9bd4-f6d989162b0c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:38.845894 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-bf595000-6c33-4bb8-9bd4-f6d989162b0c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:38.852255 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bf595000-6c33-4bb8-9bd4-f6d989162b0c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:38.852688 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bf595000-6c33-4bb8-9bd4-f6d989162b0c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:38.853450 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bf595000-6c33-4bb8-9bd4-f6d989162b0c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:38.853876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-bf595000-6c33-4bb8-9bd4-f6d989162b0c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:38.913978 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-bf595000-6c33-4bb8-9bd4-f6d989162b0c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c59be1b62c4774a050047b4f5364d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1637f6e48094653bebf0bc7af9aab9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:00:38.922039 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-bf595000-6c33-4bb8-9bd4-f6d989162b0c tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 200 len: 1509 microversion: 2.1 time: 0.080442 Jan 31 05:00:38.922606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 591/1172] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:00:38 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 1509 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:00:38.983584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-49349a21-ae31-4b64-a8ff-f7c357b8ca7f req-0b910a01-7f1e-4a91-945a-2c2a1c04da21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8e9031-6c59-42e9-9220-6a99b06a7b65", "name": "network-vif-deleted", "tag": "51f5ced7-36d1-4a88-8073-6035ed00ae5d"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:00:38.985165 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:00:38.985165 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 05:00:38.993124 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-49349a21-ae31-4b64-a8ff-f7c357b8ca7f req-0b910a01-7f1e-4a91-945a-2c2a1c04da21 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:38.994227 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-49349a21-ae31-4b64-a8ff-f7c357b8ca7f req-0b910a01-7f1e-4a91-945a-2c2a1c04da21 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:39.003960 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-49349a21-ae31-4b64-a8ff-f7c357b8ca7f req-0b910a01-7f1e-4a91-945a-2c2a1c04da21 service nova] Creating event network-vif-deleted:51f5ced7-36d1-4a88-8073-6035ed00ae5d for instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 on hv-cinder-82660 Jan 31 05:00:39.009313 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-49349a21-ae31-4b64-a8ff-f7c357b8ca7f req-0b910a01-7f1e-4a91-945a-2c2a1c04da21 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029408 Jan 31 05:00:39.009880 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 582/1173] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:00:39.939182 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:39.939737 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [instance: 6e8e9031-6c59-42e9-9220-6a99b06a7b65] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:39.945995 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:39.946433 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:39.947223 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:39.947831 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:39.961699 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] HTTP exception thrown: Instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 could not be found. Jan 31 05:00:39.964755 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Returning 404 to user: Instance 6e8e9031-6c59-42e9-9220-6a99b06a7b65 could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 05:00:39.964755 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-97f53f71-f933-4fea-9e2c-5568361bad01 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65" status: 404 len: 111 microversion: 2.1 time: 0.027707 Jan 31 05:00:39.964755 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 592/1174] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:00:39 2022] GET /compute/v2.1/servers/6e8e9031-6c59-42e9-9220-6a99b06a7b65 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 05:00:39.972391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-52ec4670-7f88-452a-8ec1-bcd331198fc9 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] Calling method '.version_select at 0x7f69f540cc10>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:39.976473 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: ERROR oslo.messaging._drivers.impl_rabbit [None req-52ec4670-7f88-452a-8ec1-bcd331198fc9 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [5290d05a-1dba-42e8-969d-b1d9f30ddfc8] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 05:00:40.983169 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO oslo.messaging._drivers.impl_rabbit [None req-52ec4670-7f88-452a-8ec1-bcd331198fc9 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] [5290d05a-1dba-42e8-969d-b1d9f30ddfc8] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 38450. Jan 31 05:00:41.045520 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-52ec4670-7f88-452a-8ec1-bcd331198fc9 tempest-TestMinimumBasicScenario-65528943 tempest-TestMinimumBasicScenario-65528943-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-581066051" status: 202 len: 0 microversion: 2.1 time: 1.077107 Jan 31 05:00:41.046114 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 583/1175] 10.222.0.21 () {58 vars in 1268 bytes} [Mon Jan 31 05:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-581066051 => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 05:00:56.230916 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1db62bcd-1fcb-49c2-987e-c3f1c2100537 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:56.231486 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1db62bcd-1fcb-49c2-987e-c3f1c2100537 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:56.237621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1db62bcd-1fcb-49c2-987e-c3f1c2100537 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:56.238062 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1db62bcd-1fcb-49c2-987e-c3f1c2100537 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:56.238852 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1db62bcd-1fcb-49c2-987e-c3f1c2100537 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:56.239285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1db62bcd-1fcb-49c2-987e-c3f1c2100537 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:56.264284 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1db62bcd-1fcb-49c2-987e-c3f1c2100537 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 05:00:56.521727 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1db62bcd-1fcb-49c2-987e-c3f1c2100537 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "DELETE /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 204 len: 0 microversion: 2.1 time: 0.294234 Jan 31 05:00:56.523138 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 593/1176] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 05:00:56 2022] DELETE /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 31 05:00:56.531119 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c7778764-b7fe-4570-aa7a-7da8a9a8555a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:56.531931 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c7778764-b7fe-4570-aa7a-7da8a9a8555a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:56.540455 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c7778764-b7fe-4570-aa7a-7da8a9a8555a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:56.544064 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c7778764-b7fe-4570-aa7a-7da8a9a8555a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:56.544064 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c7778764-b7fe-4570-aa7a-7da8a9a8555a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:56.544064 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c7778764-b7fe-4570-aa7a-7da8a9a8555a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:56.672845 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c7778764-b7fe-4570-aa7a-7da8a9a8555a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:00:56.680682 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c7778764-b7fe-4570-aa7a-7da8a9a8555a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1574 microversion: 2.1 time: 0.153278 Jan 31 05:00:56.681219 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 584/1177] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:00:56 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 05:00:57.698322 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-5404c421-6ea1-4628-b262-61a47781614b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:57.699078 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-5404c421-6ea1-4628-b262-61a47781614b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:57.705224 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5404c421-6ea1-4628-b262-61a47781614b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:57.705667 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5404c421-6ea1-4628-b262-61a47781614b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:57.706433 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5404c421-6ea1-4628-b262-61a47781614b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:57.706910 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-5404c421-6ea1-4628-b262-61a47781614b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:57.845728 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-5404c421-6ea1-4628-b262-61a47781614b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:00:57.853615 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-5404c421-6ea1-4628-b262-61a47781614b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1574 microversion: 2.1 time: 0.159839 Jan 31 05:00:57.854174 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 594/1178] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:00:57 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:00:58.871070 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-83f5c83d-9844-41ab-a281-a1534db11da7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:58.871641 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-83f5c83d-9844-41ab-a281-a1534db11da7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:00:58.877726 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-83f5c83d-9844-41ab-a281-a1534db11da7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:58.878164 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-83f5c83d-9844-41ab-a281-a1534db11da7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:58.878954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-83f5c83d-9844-41ab-a281-a1534db11da7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:58.879382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-83f5c83d-9844-41ab-a281-a1534db11da7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:58.966327 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-83f5c83d-9844-41ab-a281-a1534db11da7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:00:58.975187 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-83f5c83d-9844-41ab-a281-a1534db11da7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1508 microversion: 2.1 time: 0.108467 Jan 31 05:00:58.976009 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 585/1179] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:00:58 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1508 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:00:59.252793 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-0d4b1f5a-9822-4d5b-a86a-5b1fd781cafd req-aabf3c08-2407-4841-ab11-fd758afad6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136c717e-248a-4393-9e3b-4703b87f5ddb", "name": "network-vif-deleted", "tag": "82a03e5c-3cf4-4891-b8cf-e1bb55979dba"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:00:59.254977 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:00:59.254977 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 05:00:59.262028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-0d4b1f5a-9822-4d5b-a86a-5b1fd781cafd req-aabf3c08-2407-4841-ab11-fd758afad6db service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:00:59.265851 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-0d4b1f5a-9822-4d5b-a86a-5b1fd781cafd req-aabf3c08-2407-4841-ab11-fd758afad6db service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:00:59.273219 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-0d4b1f5a-9822-4d5b-a86a-5b1fd781cafd req-aabf3c08-2407-4841-ab11-fd758afad6db service nova] Creating event network-vif-deleted:82a03e5c-3cf4-4891-b8cf-e1bb55979dba for instance 136c717e-248a-4393-9e3b-4703b87f5ddb on hv-cinder-82660 Jan 31 05:00:59.278955 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-0d4b1f5a-9822-4d5b-a86a-5b1fd781cafd req-aabf3c08-2407-4841-ab11-fd758afad6db service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030820 Jan 31 05:00:59.279646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 595/1180] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:00:59.993870 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:00:59.994373 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:00.000889 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:00.001382 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:00.002165 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:00.002591 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:00.037040 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:00.037489 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:00.037925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lazy-loading 'fault' on Instance uuid 136c717e-248a-4393-9e3b-4703b87f5ddb {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 05:01:00.080289 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:00.089111 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-17694a6e-9df0-4a83-9227-994e89b24c86 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 200 len: 1230 microversion: 2.1 time: 0.099771 Jan 31 05:01:00.089887 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 586/1181] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:00:59 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:01.106906 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:01.107739 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:01.113812 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:01.114261 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:01.115387 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:01.115852 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:01.129452 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] HTTP exception thrown: Instance 136c717e-248a-4393-9e3b-4703b87f5ddb could not be found. Jan 31 05:01:01.130028 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Returning 404 to user: Instance 136c717e-248a-4393-9e3b-4703b87f5ddb could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 05:01:01.130854 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-eb414eab-7bc4-4ec7-aa22-e32271c9c07b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 404 len: 111 microversion: 2.1 time: 0.029178 Jan 31 05:01:01.131375 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 596/1182] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:01 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 05:01:01.223277 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1104111377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2002478922", "security_groups": [{"name": "tempest-secgroup-smoke-15449547"}], "block_device_mapping_v2": [{"uuid": "ddb19760-3a24-4b52-b720-d2ae36521b09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6fe4c16-92c7-4a31-bdef-109ade3261a7"}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:01:01.330549 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] validate_networks() for [('d6fe4c16-92c7-4a31-bdef-109ade3261a7', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 05:01:01.783972 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 05:01:01.784392 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 05:01:01.784887 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 05:01:01.785289 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 05:01:01.785692 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 05:01:01.795786 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:01.796219 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:01.797012 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:01.797442 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:01.812707 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 05:01:01.816475 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for user bcaad1042b434b5a8ff8f3a0acc585ec and project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 05:01:01.869796 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 05:01:01.871911 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddb19760-3a24-4b52-b720-d2ae36521b09',volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 05:01:02.321706 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a874353f-ab15-49b4-a06d-eb2b15420eb6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.100816 Jan 31 05:01:02.322407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 587/1183] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 05:01:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 05:01:02.332112 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-22a6f95b-c449-4163-94c1-30e5531e4d81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:02.332793 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-22a6f95b-c449-4163-94c1-30e5531e4d81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:02.388121 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-22a6f95b-c449-4163-94c1-30e5531e4d81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:02.394904 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-22a6f95b-c449-4163-94c1-30e5531e4d81 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1095 microversion: 2.1 time: 0.066433 Jan 31 05:01:02.395671 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 597/1184] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:02 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 05:01:03.412493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-4d7bab05-bfb3-425a-bfcf-8a3665f98525 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:03.413062 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-4d7bab05-bfb3-425a-bfcf-8a3665f98525 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:03.419196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d7bab05-bfb3-425a-bfcf-8a3665f98525 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:03.419631 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d7bab05-bfb3-425a-bfcf-8a3665f98525 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:03.420391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d7bab05-bfb3-425a-bfcf-8a3665f98525 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:03.420811 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-4d7bab05-bfb3-425a-bfcf-8a3665f98525 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:03.487061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-4d7bab05-bfb3-425a-bfcf-8a3665f98525 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:03.492092 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-4d7bab05-bfb3-425a-bfcf-8a3665f98525 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1145 microversion: 2.1 time: 0.083880 Jan 31 05:01:03.492642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 588/1185] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:03 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:04.508353 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b4314186-d7a8-408c-8b6d-4a2f18eca39a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:04.508965 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b4314186-d7a8-408c-8b6d-4a2f18eca39a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:04.517872 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4314186-d7a8-408c-8b6d-4a2f18eca39a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:04.518322 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4314186-d7a8-408c-8b6d-4a2f18eca39a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:04.519190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4314186-d7a8-408c-8b6d-4a2f18eca39a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:04.519810 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b4314186-d7a8-408c-8b6d-4a2f18eca39a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:04.579652 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b4314186-d7a8-408c-8b6d-4a2f18eca39a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:04.587566 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b4314186-d7a8-408c-8b6d-4a2f18eca39a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1211 microversion: 2.1 time: 0.082810 Jan 31 05:01:04.588099 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 598/1186] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:04 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:05.604246 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cef92c9e-c2aa-46a9-8861-d1ba11dbe0ff tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:05.604934 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cef92c9e-c2aa-46a9-8861-d1ba11dbe0ff tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:05.611565 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cef92c9e-c2aa-46a9-8861-d1ba11dbe0ff tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:05.614618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cef92c9e-c2aa-46a9-8861-d1ba11dbe0ff tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:05.614618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cef92c9e-c2aa-46a9-8861-d1ba11dbe0ff tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:05.614618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cef92c9e-c2aa-46a9-8861-d1ba11dbe0ff tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:05.860689 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cef92c9e-c2aa-46a9-8861-d1ba11dbe0ff tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:05.870663 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cef92c9e-c2aa-46a9-8861-d1ba11dbe0ff tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.270648 Jan 31 05:01:05.871282 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 589/1187] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:05 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:06.071357 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-ace240a9-6b92-4ddf-9200-c7203f743877 req-3b4e9a84-b142-4ef8-a17d-79cf6ab58338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c", "tag": "67da84bc-ecc7-4515-833e-0b8f7bdae679"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:01:06.072794 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:01:06.072794 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 05:01:06.087320 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ace240a9-6b92-4ddf-9200-c7203f743877 req-3b4e9a84-b142-4ef8-a17d-79cf6ab58338 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:06.088161 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-ace240a9-6b92-4ddf-9200-c7203f743877 req-3b4e9a84-b142-4ef8-a17d-79cf6ab58338 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:06.102179 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-ace240a9-6b92-4ddf-9200-c7203f743877 req-3b4e9a84-b142-4ef8-a17d-79cf6ab58338 service nova] Creating event network-changed:67da84bc-ecc7-4515-833e-0b8f7bdae679 for instance 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c on hv-cinder-82660 Jan 31 05:01:06.107220 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-ace240a9-6b92-4ddf-9200-c7203f743877 req-3b4e9a84-b142-4ef8-a17d-79cf6ab58338 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040250 Jan 31 05:01:06.108312 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 599/1188] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:01:06.887518 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e5b5157b-969c-4b6b-b11f-c4d599a6cf79 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:06.888122 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e5b5157b-969c-4b6b-b11f-c4d599a6cf79 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:06.894413 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e5b5157b-969c-4b6b-b11f-c4d599a6cf79 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:06.894810 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e5b5157b-969c-4b6b-b11f-c4d599a6cf79 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:06.895607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e5b5157b-969c-4b6b-b11f-c4d599a6cf79 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:06.896033 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e5b5157b-969c-4b6b-b11f-c4d599a6cf79 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:07.115341 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e5b5157b-969c-4b6b-b11f-c4d599a6cf79 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:07.123172 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e5b5157b-969c-4b6b-b11f-c4d599a6cf79 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.239235 Jan 31 05:01:07.123721 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 590/1189] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:06 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:08.141029 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7109fb39-5f52-4d79-8905-f00e69e2fdc8 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:08.141723 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7109fb39-5f52-4d79-8905-f00e69e2fdc8 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:08.147777 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7109fb39-5f52-4d79-8905-f00e69e2fdc8 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:08.148217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7109fb39-5f52-4d79-8905-f00e69e2fdc8 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:08.148975 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7109fb39-5f52-4d79-8905-f00e69e2fdc8 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:08.149432 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7109fb39-5f52-4d79-8905-f00e69e2fdc8 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:08.280977 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7109fb39-5f52-4d79-8905-f00e69e2fdc8 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:08.288156 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7109fb39-5f52-4d79-8905-f00e69e2fdc8 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.151570 Jan 31 05:01:08.288707 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 600/1190] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:08 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:09.304698 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-03472ddb-fa37-48bb-b276-d742d7ceffd6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:09.305307 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-03472ddb-fa37-48bb-b276-d742d7ceffd6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:09.311974 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-03472ddb-fa37-48bb-b276-d742d7ceffd6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:09.312445 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-03472ddb-fa37-48bb-b276-d742d7ceffd6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:09.313190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-03472ddb-fa37-48bb-b276-d742d7ceffd6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:09.313622 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-03472ddb-fa37-48bb-b276-d742d7ceffd6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:09.554961 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-03472ddb-fa37-48bb-b276-d742d7ceffd6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:09.562172 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-03472ddb-fa37-48bb-b276-d742d7ceffd6 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.261131 Jan 31 05:01:09.562732 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 591/1191] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:09 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:10.578519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eb581531-b88a-4b12-ba6d-2a87847674f9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:10.579172 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-eb581531-b88a-4b12-ba6d-2a87847674f9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:10.585344 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb581531-b88a-4b12-ba6d-2a87847674f9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:10.585792 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb581531-b88a-4b12-ba6d-2a87847674f9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:10.586553 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb581531-b88a-4b12-ba6d-2a87847674f9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:10.587645 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb581531-b88a-4b12-ba6d-2a87847674f9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:10.724528 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eb581531-b88a-4b12-ba6d-2a87847674f9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:10.732180 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-eb581531-b88a-4b12-ba6d-2a87847674f9 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.157274 Jan 31 05:01:10.732742 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 601/1192] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:10 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:11.749030 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-5c14026f-f6c8-44c6-9a99-944e7b606ffe tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:11.749617 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-5c14026f-f6c8-44c6-9a99-944e7b606ffe tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:11.755847 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5c14026f-f6c8-44c6-9a99-944e7b606ffe tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:11.756287 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5c14026f-f6c8-44c6-9a99-944e7b606ffe tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:11.757042 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5c14026f-f6c8-44c6-9a99-944e7b606ffe tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:11.757471 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-5c14026f-f6c8-44c6-9a99-944e7b606ffe tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:11.888531 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-5c14026f-f6c8-44c6-9a99-944e7b606ffe tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:11.895925 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-5c14026f-f6c8-44c6-9a99-944e7b606ffe tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.150466 Jan 31 05:01:11.896488 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 592/1193] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:11 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:12.913088 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-7dc407d0-0355-4a29-8209-82324dd66eab tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:12.913641 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-7dc407d0-0355-4a29-8209-82324dd66eab tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:12.920757 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7dc407d0-0355-4a29-8209-82324dd66eab tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:12.921193 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7dc407d0-0355-4a29-8209-82324dd66eab tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:12.921949 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7dc407d0-0355-4a29-8209-82324dd66eab tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:12.922382 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-7dc407d0-0355-4a29-8209-82324dd66eab tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:13.054410 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-7dc407d0-0355-4a29-8209-82324dd66eab tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:13.061965 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-7dc407d0-0355-4a29-8209-82324dd66eab tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.152553 Jan 31 05:01:13.062522 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 602/1194] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:12 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:14.078272 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-47ecb0e8-520c-47d3-8157-9367e8ecc188 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:14.078922 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-47ecb0e8-520c-47d3-8157-9367e8ecc188 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:14.085532 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47ecb0e8-520c-47d3-8157-9367e8ecc188 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:14.085786 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47ecb0e8-520c-47d3-8157-9367e8ecc188 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:14.086471 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47ecb0e8-520c-47d3-8157-9367e8ecc188 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:14.087546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-47ecb0e8-520c-47d3-8157-9367e8ecc188 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:14.223812 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-47ecb0e8-520c-47d3-8157-9367e8ecc188 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:14.231117 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-47ecb0e8-520c-47d3-8157-9367e8ecc188 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.156523 Jan 31 05:01:14.231682 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 593/1195] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:14 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:15.247788 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c0228125-7394-474c-9cee-99a9f6b848b3 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:15.248389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c0228125-7394-474c-9cee-99a9f6b848b3 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:15.254551 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c0228125-7394-474c-9cee-99a9f6b848b3 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:15.255295 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c0228125-7394-474c-9cee-99a9f6b848b3 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:15.256063 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c0228125-7394-474c-9cee-99a9f6b848b3 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:15.256494 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c0228125-7394-474c-9cee-99a9f6b848b3 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:15.391366 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c0228125-7394-474c-9cee-99a9f6b848b3 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:15.398486 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c0228125-7394-474c-9cee-99a9f6b848b3 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.154414 Jan 31 05:01:15.399073 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 603/1196] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:15 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:16.020602 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-c6b88fe4-5f4d-4900-8297-2f151077d39a req-ee302740-f726-4006-acde-330ec1d8274f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c", "name": "network-vif-plugged", "status": "completed", "tag": "67da84bc-ecc7-4515-833e-0b8f7bdae679"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:01:16.022284 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:01:16.022284 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 05:01:16.030503 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-c6b88fe4-5f4d-4900-8297-2f151077d39a req-ee302740-f726-4006-acde-330ec1d8274f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:16.030982 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-c6b88fe4-5f4d-4900-8297-2f151077d39a req-ee302740-f726-4006-acde-330ec1d8274f service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:16.042110 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-c6b88fe4-5f4d-4900-8297-2f151077d39a req-ee302740-f726-4006-acde-330ec1d8274f service nova] Creating event network-vif-plugged:67da84bc-ecc7-4515-833e-0b8f7bdae679 for instance 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c on hv-cinder-82660 Jan 31 05:01:16.047233 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-c6b88fe4-5f4d-4900-8297-2f151077d39a req-ee302740-f726-4006-acde-330ec1d8274f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030317 Jan 31 05:01:16.052030 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 594/1197] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:01:16.414743 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-00d707ab-3e9d-4848-b0f1-aac37d768d40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:16.415570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-00d707ab-3e9d-4848-b0f1-aac37d768d40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:16.421897 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00d707ab-3e9d-4848-b0f1-aac37d768d40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:16.422338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00d707ab-3e9d-4848-b0f1-aac37d768d40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:16.423149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00d707ab-3e9d-4848-b0f1-aac37d768d40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:16.423579 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-00d707ab-3e9d-4848-b0f1-aac37d768d40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:16.560961 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-00d707ab-3e9d-4848-b0f1-aac37d768d40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:16.568358 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-00d707ab-3e9d-4848-b0f1-aac37d768d40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.156925 Jan 31 05:01:16.568854 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 604/1198] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:16 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:17.584844 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-78d416a2-f0b2-4b86-9627-d3345a30f344 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:17.585560 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-78d416a2-f0b2-4b86-9627-d3345a30f344 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:17.592205 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-78d416a2-f0b2-4b86-9627-d3345a30f344 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:17.592642 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-78d416a2-f0b2-4b86-9627-d3345a30f344 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:17.593398 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-78d416a2-f0b2-4b86-9627-d3345a30f344 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:17.593852 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-78d416a2-f0b2-4b86-9627-d3345a30f344 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:17.730402 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-78d416a2-f0b2-4b86-9627-d3345a30f344 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:17.737829 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-78d416a2-f0b2-4b86-9627-d3345a30f344 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1265 microversion: 2.1 time: 0.157005 Jan 31 05:01:17.738391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 595/1199] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:17 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:18.756228 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-f75b403a-2522-4f7e-8179-dbdf40c20c3c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:18.756825 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-f75b403a-2522-4f7e-8179-dbdf40c20c3c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:18.762996 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f75b403a-2522-4f7e-8179-dbdf40c20c3c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:18.763436 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f75b403a-2522-4f7e-8179-dbdf40c20c3c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:18.764191 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f75b403a-2522-4f7e-8179-dbdf40c20c3c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:18.764621 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-f75b403a-2522-4f7e-8179-dbdf40c20c3c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:18.894317 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-f75b403a-2522-4f7e-8179-dbdf40c20c3c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:18.902074 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-f75b403a-2522-4f7e-8179-dbdf40c20c3c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1451 microversion: 2.1 time: 0.149431 Jan 31 05:01:18.902568 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 605/1200] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:18 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:18.917910 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a8991b5f-b0b4-4b1b-bcfe-a19c94b58c64 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:01:18.918519 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a8991b5f-b0b4-4b1b-bcfe-a19c94b58c64 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:01:18.924663 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a8991b5f-b0b4-4b1b-bcfe-a19c94b58c64 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:18.925110 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a8991b5f-b0b4-4b1b-bcfe-a19c94b58c64 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:18.925881 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a8991b5f-b0b4-4b1b-bcfe-a19c94b58c64 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:18.926323 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a8991b5f-b0b4-4b1b-bcfe-a19c94b58c64 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:19.066297 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a8991b5f-b0b4-4b1b-bcfe-a19c94b58c64 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:01:19.073861 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a8991b5f-b0b4-4b1b-bcfe-a19c94b58c64 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1451 microversion: 2.1 time: 0.160154 Jan 31 05:01:19.074443 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 596/1201] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:01:18 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:01:21.014283 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-74861ebd-8ff4-435b-bf14-4b539c7d5154 req-bd124711-2573-4da7-8de6-66981a7e6aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c", "tag": "67da84bc-ecc7-4515-833e-0b8f7bdae679"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:01:21.015889 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:01:21.015889 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 05:01:21.023400 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-74861ebd-8ff4-435b-bf14-4b539c7d5154 req-bd124711-2573-4da7-8de6-66981a7e6aa0 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:01:21.028642 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-74861ebd-8ff4-435b-bf14-4b539c7d5154 req-bd124711-2573-4da7-8de6-66981a7e6aa0 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:01:21.035043 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-74861ebd-8ff4-435b-bf14-4b539c7d5154 req-bd124711-2573-4da7-8de6-66981a7e6aa0 service nova] Creating event network-changed:67da84bc-ecc7-4515-833e-0b8f7bdae679 for instance 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c on hv-cinder-82660 Jan 31 05:01:21.040225 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-74861ebd-8ff4-435b-bf14-4b539c7d5154 req-bd124711-2573-4da7-8de6-66981a7e6aa0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029423 Jan 31 05:01:21.040814 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 606/1202] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:02:12.973541 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:02:12.974216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 05:02:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:03:21.181882 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1883709745", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2002478922", "security_groups": [{"name": "tempest-secgroup-smoke-15449547"}], "block_device_mapping_v2": [{"uuid": "be1d7bc1-f37f-4b24-8d16-d06332098e26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6fe4c16-92c7-4a31-bdef-109ade3261a7"}]}} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:03:21.287618 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.network.neutron [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] validate_networks() for [('d6fe4c16-92c7-4a31-bdef-109ade3261a7', None, None, None, None, None)] {{(pid=123367) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 05:03:21.641449 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Flavor limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 05:03:21.641919 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Image limits 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 05:03:21.642336 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Flavor pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 05:03:21.642741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Image pref 0:0:0 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 05:03:21.643182 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.virt.hardware [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 05:03:21.652296 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:21.652735 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:21.653525 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:21.653954 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:21.669553 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 05:03:21.673353 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.quota [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Getting quotas for user bcaad1042b434b5a8ff8f3a0acc585ec and project 4cf3ab219d9f44e1ab973f1d63347066. Resources: {'instances', 'cores', 'ram'} {{(pid=123367) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 05:03:21.727414 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Going to run 1 instances... {{(pid=123367) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 05:03:21.729580 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be1d7bc1-f37f-4b24-8d16-d06332098e26',volume_size=None,volume_type=None)] {{(pid=123367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 05:03:22.128156 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-07c6fc8f-2d43-4196-a278-8565ec065d97 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.951005 Jan 31 05:03:22.128794 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 597/1203] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Jan 31 05:03:21 2022] POST /compute/v2.1/servers => generated 404 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 05:03:22.137715 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dedc63b2-997f-4eab-84ca-faf6a5368345] AMQP server on 10.222.0.21:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 31 05:03:22.141527 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2c59da7b-ccc8-4109-b5a6-3ddd4f7dc7e0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:22.142216 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2c59da7b-ccc8-4109-b5a6-3ddd4f7dc7e0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:22.201207 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-2c59da7b-ccc8-4109-b5a6-3ddd4f7dc7e0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:22.207517 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2c59da7b-ccc8-4109-b5a6-3ddd4f7dc7e0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1095 microversion: 2.1 time: 0.072377 Jan 31 05:03:22.208066 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 607/1204] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:22 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:23.224441 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-b733d4ff-a1a0-43b8-adbc-359e11d573bc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:23.225038 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-b733d4ff-a1a0-43b8-adbc-359e11d573bc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:23.231744 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b733d4ff-a1a0-43b8-adbc-359e11d573bc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:23.232223 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b733d4ff-a1a0-43b8-adbc-359e11d573bc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:23.233066 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b733d4ff-a1a0-43b8-adbc-359e11d573bc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:23.233495 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-b733d4ff-a1a0-43b8-adbc-359e11d573bc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:23.293417 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-b733d4ff-a1a0-43b8-adbc-359e11d573bc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:23.300716 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-b733d4ff-a1a0-43b8-adbc-359e11d573bc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1145 microversion: 2.1 time: 0.081020 Jan 31 05:03:23.301334 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 598/1205] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:23 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:24.317122 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-eb32507e-700b-420c-b7a1-efbcd5698c07 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:24.317865 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-eb32507e-700b-420c-b7a1-efbcd5698c07 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:24.331503 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb32507e-700b-420c-b7a1-efbcd5698c07 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:24.332057 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb32507e-700b-420c-b7a1-efbcd5698c07 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:24.332923 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb32507e-700b-420c-b7a1-efbcd5698c07 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:24.333557 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-eb32507e-700b-420c-b7a1-efbcd5698c07 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:24.339275 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] [dedc63b2-997f-4eab-84ca-faf6a5368345] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 38712. Jan 31 05:03:24.394782 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-eb32507e-700b-420c-b7a1-efbcd5698c07 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:24.403266 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-eb32507e-700b-420c-b7a1-efbcd5698c07 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1211 microversion: 2.1 time: 0.089685 Jan 31 05:03:24.403900 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 608/1206] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:24 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:25.420611 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-fca21287-8f6d-44fd-bbd8-4c528c491c40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:25.421222 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-fca21287-8f6d-44fd-bbd8-4c528c491c40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:25.428493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fca21287-8f6d-44fd-bbd8-4c528c491c40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:25.428493 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fca21287-8f6d-44fd-bbd8-4c528c491c40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:25.429555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fca21287-8f6d-44fd-bbd8-4c528c491c40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:25.429555 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-fca21287-8f6d-44fd-bbd8-4c528c491c40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:25.666030 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-fca21287-8f6d-44fd-bbd8-4c528c491c40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:25.673471 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-fca21287-8f6d-44fd-bbd8-4c528c491c40 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1277 microversion: 2.1 time: 0.256644 Jan 31 05:03:25.674037 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 599/1207] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:25 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:25.924142 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-fbad446d-dd93-4358-b511-122a4788dffe req-17df910d-bc70-4988-9785-7237dab100fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81d5946-7c48-488c-b6b1-ed198857128f", "tag": "31310b8b-ebdf-414b-9984-e3252a54c75e"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:03:25.925788 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:03:25.925788 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 05:03:25.933918 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-fbad446d-dd93-4358-b511-122a4788dffe req-17df910d-bc70-4988-9785-7237dab100fc service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:25.934358 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-fbad446d-dd93-4358-b511-122a4788dffe req-17df910d-bc70-4988-9785-7237dab100fc service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:25.945860 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-fbad446d-dd93-4358-b511-122a4788dffe req-17df910d-bc70-4988-9785-7237dab100fc service nova] Creating event network-changed:31310b8b-ebdf-414b-9984-e3252a54c75e for instance f81d5946-7c48-488c-b6b1-ed198857128f on hv-cinder-82660 Jan 31 05:03:25.951152 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-fbad446d-dd93-4358-b511-122a4788dffe req-17df910d-bc70-4988-9785-7237dab100fc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096535 Jan 31 05:03:25.952319 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 609/1208] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:03:26.690590 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-62365cc3-03e3-4d12-a67a-e4fed327c24a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:26.691247 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-62365cc3-03e3-4d12-a67a-e4fed327c24a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:26.697583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62365cc3-03e3-4d12-a67a-e4fed327c24a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:26.698028 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62365cc3-03e3-4d12-a67a-e4fed327c24a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:26.698924 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62365cc3-03e3-4d12-a67a-e4fed327c24a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:26.699363 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-62365cc3-03e3-4d12-a67a-e4fed327c24a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:26.908100 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-62365cc3-03e3-4d12-a67a-e4fed327c24a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:26.916196 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-62365cc3-03e3-4d12-a67a-e4fed327c24a tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.229183 Jan 31 05:03:26.916763 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 600/1209] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:26 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:27.934855 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-c692b083-9924-498f-93ec-e82b690be336 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:27.935546 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-c692b083-9924-498f-93ec-e82b690be336 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:27.941523 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c692b083-9924-498f-93ec-e82b690be336 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:27.941967 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c692b083-9924-498f-93ec-e82b690be336 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:27.942731 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c692b083-9924-498f-93ec-e82b690be336 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:27.943186 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-c692b083-9924-498f-93ec-e82b690be336 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:28.074946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-c692b083-9924-498f-93ec-e82b690be336 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:28.082562 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-c692b083-9924-498f-93ec-e82b690be336 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.153324 Jan 31 05:03:28.083147 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 610/1210] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:27 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:29.098903 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-c4d1d1e6-89e6-4036-99a5-b91fd456be48 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:29.104750 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-c4d1d1e6-89e6-4036-99a5-b91fd456be48 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:29.106546 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c4d1d1e6-89e6-4036-99a5-b91fd456be48 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:29.107031 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c4d1d1e6-89e6-4036-99a5-b91fd456be48 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:29.107808 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c4d1d1e6-89e6-4036-99a5-b91fd456be48 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:29.108244 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-c4d1d1e6-89e6-4036-99a5-b91fd456be48 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:29.248446 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-c4d1d1e6-89e6-4036-99a5-b91fd456be48 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:29.255583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-c4d1d1e6-89e6-4036-99a5-b91fd456be48 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.160490 Jan 31 05:03:29.256135 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 601/1211] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:29 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:30.272889 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4c0a98f5-a1be-4f69-a9c0-1078c39a7ec5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:30.274036 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4c0a98f5-a1be-4f69-a9c0-1078c39a7ec5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:30.280220 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4c0a98f5-a1be-4f69-a9c0-1078c39a7ec5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:30.280654 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4c0a98f5-a1be-4f69-a9c0-1078c39a7ec5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:30.281414 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4c0a98f5-a1be-4f69-a9c0-1078c39a7ec5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:30.281839 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4c0a98f5-a1be-4f69-a9c0-1078c39a7ec5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:30.417876 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4c0a98f5-a1be-4f69-a9c0-1078c39a7ec5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:30.425003 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4c0a98f5-a1be-4f69-a9c0-1078c39a7ec5 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.155854 Jan 31 05:03:30.425556 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 611/1212] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:30 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:31.441149 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ab254755-6620-4997-9242-dabd68ebb5ef tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:31.441765 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ab254755-6620-4997-9242-dabd68ebb5ef tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:31.448796 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ab254755-6620-4997-9242-dabd68ebb5ef tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:31.449237 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ab254755-6620-4997-9242-dabd68ebb5ef tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:31.450003 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ab254755-6620-4997-9242-dabd68ebb5ef tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:31.450434 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ab254755-6620-4997-9242-dabd68ebb5ef tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:31.579696 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-ab254755-6620-4997-9242-dabd68ebb5ef tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:31.587655 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ab254755-6620-4997-9242-dabd68ebb5ef tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.150143 Jan 31 05:03:31.588217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 602/1213] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:31 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:32.603540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-1f0f2727-28ff-43d8-9191-5907058d328e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:32.604149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-1f0f2727-28ff-43d8-9191-5907058d328e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:32.610377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f0f2727-28ff-43d8-9191-5907058d328e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:32.610843 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f0f2727-28ff-43d8-9191-5907058d328e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:32.611858 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f0f2727-28ff-43d8-9191-5907058d328e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:32.612285 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-1f0f2727-28ff-43d8-9191-5907058d328e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:32.744364 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-1f0f2727-28ff-43d8-9191-5907058d328e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:32.751568 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-1f0f2727-28ff-43d8-9191-5907058d328e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.152250 Jan 31 05:03:32.752119 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 612/1214] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:32 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:33.768302 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-06337270-4a93-4469-a6f5-f64d0d653f20 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:33.768901 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-06337270-4a93-4469-a6f5-f64d0d653f20 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:33.775233 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06337270-4a93-4469-a6f5-f64d0d653f20 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:33.775672 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06337270-4a93-4469-a6f5-f64d0d653f20 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:33.776427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06337270-4a93-4469-a6f5-f64d0d653f20 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:33.776856 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-06337270-4a93-4469-a6f5-f64d0d653f20 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:33.910498 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-06337270-4a93-4469-a6f5-f64d0d653f20 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:33.918212 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-06337270-4a93-4469-a6f5-f64d0d653f20 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.153683 Jan 31 05:03:33.918761 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 603/1215] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:33 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:34.934749 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-cbba906d-f3e2-443b-862f-5c8c90c26a1b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:34.935391 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-cbba906d-f3e2-443b-862f-5c8c90c26a1b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:34.941511 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbba906d-f3e2-443b-862f-5c8c90c26a1b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:34.941950 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbba906d-f3e2-443b-862f-5c8c90c26a1b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:34.942710 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbba906d-f3e2-443b-862f-5c8c90c26a1b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:34.943230 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-cbba906d-f3e2-443b-862f-5c8c90c26a1b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:35.077648 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-cbba906d-f3e2-443b-862f-5c8c90c26a1b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:35.084930 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-cbba906d-f3e2-443b-862f-5c8c90c26a1b tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.153771 Jan 31 05:03:35.085484 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 613/1216] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:34 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:36.101324 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-94fac363-a4e6-4268-8e5b-0484756c00d2 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:36.107994 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-94fac363-a4e6-4268-8e5b-0484756c00d2 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:36.108900 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-94fac363-a4e6-4268-8e5b-0484756c00d2 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:36.109342 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-94fac363-a4e6-4268-8e5b-0484756c00d2 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:36.110099 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-94fac363-a4e6-4268-8e5b-0484756c00d2 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:36.110528 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-94fac363-a4e6-4268-8e5b-0484756c00d2 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:36.243178 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-94fac363-a4e6-4268-8e5b-0484756c00d2 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:36.250243 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-94fac363-a4e6-4268-8e5b-0484756c00d2 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.152634 Jan 31 05:03:36.250819 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 604/1217] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:36 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:37.267530 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b9421e46-94a0-4d5d-832d-1f896cb4bd04 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:37.268129 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b9421e46-94a0-4d5d-832d-1f896cb4bd04 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:37.275369 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b9421e46-94a0-4d5d-832d-1f896cb4bd04 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:37.275947 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b9421e46-94a0-4d5d-832d-1f896cb4bd04 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:37.276810 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b9421e46-94a0-4d5d-832d-1f896cb4bd04 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:37.277243 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b9421e46-94a0-4d5d-832d-1f896cb4bd04 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:37.427105 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b9421e46-94a0-4d5d-832d-1f896cb4bd04 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:37.435222 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b9421e46-94a0-4d5d-832d-1f896cb4bd04 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.171540 Jan 31 05:03:37.435773 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 614/1218] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:37 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:38.457217 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-a46290de-ac1a-498d-b223-a86b2535227f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:38.457953 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-a46290de-ac1a-498d-b223-a86b2535227f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:38.463928 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a46290de-ac1a-498d-b223-a86b2535227f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:38.464377 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a46290de-ac1a-498d-b223-a86b2535227f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:38.465157 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a46290de-ac1a-498d-b223-a86b2535227f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:38.465597 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-a46290de-ac1a-498d-b223-a86b2535227f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:38.580020 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-8a5bdc49-de55-4ca2-93f4-96b205a8a1ab req-989117b5-6ab8-457b-b5dd-857b131a9b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f81d5946-7c48-488c-b6b1-ed198857128f", "name": "network-vif-plugged", "status": "completed", "tag": "31310b8b-ebdf-414b-9984-e3252a54c75e"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:03:38.582290 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:03:38.582290 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 05:03:38.588317 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-8a5bdc49-de55-4ca2-93f4-96b205a8a1ab req-989117b5-6ab8-457b-b5dd-857b131a9b2b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:38.588806 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-8a5bdc49-de55-4ca2-93f4-96b205a8a1ab req-989117b5-6ab8-457b-b5dd-857b131a9b2b service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:38.599855 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-8a5bdc49-de55-4ca2-93f4-96b205a8a1ab req-989117b5-6ab8-457b-b5dd-857b131a9b2b service nova] Creating event network-vif-plugged:31310b8b-ebdf-414b-9984-e3252a54c75e for instance f81d5946-7c48-488c-b6b1-ed198857128f on hv-cinder-82660 Jan 31 05:03:38.606162 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-8a5bdc49-de55-4ca2-93f4-96b205a8a1ab req-989117b5-6ab8-457b-b5dd-857b131a9b2b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085289 Jan 31 05:03:38.607094 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 615/1219] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 05:03:38.608159 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-a46290de-ac1a-498d-b223-a86b2535227f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:38.615993 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-a46290de-ac1a-498d-b223-a86b2535227f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.162447 Jan 31 05:03:38.617159 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 605/1220] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:38 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:39.633789 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a940f20d-0875-493e-a1d5-7c0318694ebc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:39.634491 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a940f20d-0875-493e-a1d5-7c0318694ebc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:39.640729 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a940f20d-0875-493e-a1d5-7c0318694ebc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:39.641172 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a940f20d-0875-493e-a1d5-7c0318694ebc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:39.641962 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a940f20d-0875-493e-a1d5-7c0318694ebc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:39.642393 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a940f20d-0875-493e-a1d5-7c0318694ebc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:39.775442 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-a940f20d-0875-493e-a1d5-7c0318694ebc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:39.782524 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a940f20d-0875-493e-a1d5-7c0318694ebc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1265 microversion: 2.1 time: 0.153276 Jan 31 05:03:39.783115 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 616/1221] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:39 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:40.798721 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-769bd0f5-26dc-4683-b067-499e32363e90 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:40.799383 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-769bd0f5-26dc-4683-b067-499e32363e90 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:40.806707 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-769bd0f5-26dc-4683-b067-499e32363e90 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:40.807204 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-769bd0f5-26dc-4683-b067-499e32363e90 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:40.807973 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-769bd0f5-26dc-4683-b067-499e32363e90 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:40.808407 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-769bd0f5-26dc-4683-b067-499e32363e90 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:40.938436 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-769bd0f5-26dc-4683-b067-499e32363e90 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:40.945616 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-769bd0f5-26dc-4683-b067-499e32363e90 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1451 microversion: 2.1 time: 0.150483 Jan 31 05:03:40.946190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 606/1222] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:40 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:40.960880 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-d361bfbf-2362-4f03-a973-7824cc06018e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:03:40.961519 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-d361bfbf-2362-4f03-a973-7824cc06018e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:03:40.967700 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d361bfbf-2362-4f03-a973-7824cc06018e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:40.968143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d361bfbf-2362-4f03-a973-7824cc06018e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:40.968905 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d361bfbf-2362-4f03-a973-7824cc06018e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:40.969338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-d361bfbf-2362-4f03-a973-7824cc06018e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:41.111221 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-d361bfbf-2362-4f03-a973-7824cc06018e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:03:41.112207 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-d361bfbf-2362-4f03-a973-7824cc06018e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1451 microversion: 2.1 time: 0.154885 Jan 31 05:03:41.112763 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 617/1223] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:03:40 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:03:43.327786 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-90a5b30e-5ea3-4d7b-93c7-f5f61b5c14c4 req-002e223f-0153-43a1-a4f8-227054be87aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81d5946-7c48-488c-b6b1-ed198857128f", "tag": "31310b8b-ebdf-414b-9984-e3252a54c75e"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:03:43.329798 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:03:43.329798 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 05:03:43.345249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-90a5b30e-5ea3-4d7b-93c7-f5f61b5c14c4 req-002e223f-0153-43a1-a4f8-227054be87aa service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:03:43.345249 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-90a5b30e-5ea3-4d7b-93c7-f5f61b5c14c4 req-002e223f-0153-43a1-a4f8-227054be87aa service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:03:43.351354 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-90a5b30e-5ea3-4d7b-93c7-f5f61b5c14c4 req-002e223f-0153-43a1-a4f8-227054be87aa service nova] Creating event network-changed:31310b8b-ebdf-414b-9984-e3252a54c75e for instance f81d5946-7c48-488c-b6b1-ed198857128f on hv-cinder-82660 Jan 31 05:03:43.357571 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-90a5b30e-5ea3-4d7b-93c7-f5f61b5c14c4 req-002e223f-0153-43a1-a4f8-227054be87aa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033850 Jan 31 05:03:43.358163 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 607/1224] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:03:47.762978 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:03:47.763493 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 05:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:05:32.983005 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:05:32.984052 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 05:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:05:33.420391 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e70ac75-9570-4dc3-9fe0-2d167b3c63be] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 05:05:33.431246 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-2dee543c-222a-4ad0-a135-d543931d4b15 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:33.431246 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2dee543c-222a-4ad0-a135-d543931d4b15 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:33.431246 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2dee543c-222a-4ad0-a135-d543931d4b15 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:33.431246 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2dee543c-222a-4ad0-a135-d543931d4b15 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:33.432197 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2dee543c-222a-4ad0-a135-d543931d4b15 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:33.432197 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-2dee543c-222a-4ad0-a135-d543931d4b15 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:33.457428 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-2dee543c-222a-4ad0-a135-d543931d4b15 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Going to try to terminate instance {{(pid=123368) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 05:05:33.486267 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-43a68e7d-cb80-408f-af30-3d1411ddd730 req-b047f1cb-6c4f-4855-8816-af630c3eace1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81d5946-7c48-488c-b6b1-ed198857128f", "tag": "31310b8b-ebdf-414b-9984-e3252a54c75e"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:05:33.488583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:05:33.488583 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 05:05:33.495821 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-43a68e7d-cb80-408f-af30-3d1411ddd730 req-b047f1cb-6c4f-4855-8816-af630c3eace1 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:33.496309 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-43a68e7d-cb80-408f-af30-3d1411ddd730 req-b047f1cb-6c4f-4855-8816-af630c3eace1 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:33.507008 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-43a68e7d-cb80-408f-af30-3d1411ddd730 req-b047f1cb-6c4f-4855-8816-af630c3eace1 service nova] Creating event network-changed:31310b8b-ebdf-414b-9984-e3252a54c75e for instance f81d5946-7c48-488c-b6b1-ed198857128f on hv-cinder-82660 Jan 31 05:05:33.512105 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-43a68e7d-cb80-408f-af30-3d1411ddd730 req-b047f1cb-6c4f-4855-8816-af630c3eace1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094079 Jan 31 05:05:33.517907 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 608/1225] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:05:33.764139 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-2dee543c-222a-4ad0-a135-d543931d4b15 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 204 len: 0 microversion: 2.1 time: 0.348363 Jan 31 05:05:33.764720 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 618/1226] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 05:05:33 2022] DELETE /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 05:05:33.774920 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-2b9491a8-cb57-4b88-9d1c-2bd8106f4247 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:33.774920 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-2b9491a8-cb57-4b88-9d1c-2bd8106f4247 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:33.780656 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2b9491a8-cb57-4b88-9d1c-2bd8106f4247 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:33.781107 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2b9491a8-cb57-4b88-9d1c-2bd8106f4247 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:33.781879 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2b9491a8-cb57-4b88-9d1c-2bd8106f4247 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:33.782310 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-2b9491a8-cb57-4b88-9d1c-2bd8106f4247 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:33.999741 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-2b9491a8-cb57-4b88-9d1c-2bd8106f4247 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:05:34.007577 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-2b9491a8-cb57-4b88-9d1c-2bd8106f4247 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1576 microversion: 2.1 time: 0.238386 Jan 31 05:05:34.008933 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 609/1227] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:33 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 05:05:35.026637 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-b52e1c5b-c41b-46e8-aebb-6b1818132039 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:35.027438 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-b52e1c5b-c41b-46e8-aebb-6b1818132039 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:35.035176 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b52e1c5b-c41b-46e8-aebb-6b1818132039 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:35.035636 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b52e1c5b-c41b-46e8-aebb-6b1818132039 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:35.036384 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b52e1c5b-c41b-46e8-aebb-6b1818132039 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:35.036809 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-b52e1c5b-c41b-46e8-aebb-6b1818132039 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:35.225435 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-b52e1c5b-c41b-46e8-aebb-6b1818132039 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:05:35.233385 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-b52e1c5b-c41b-46e8-aebb-6b1818132039 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1457 microversion: 2.1 time: 0.210795 Jan 31 05:05:35.233940 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 619/1228] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:35 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1457 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:05:36.069268 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [req-af9f6342-60c0-4d9a-accb-0e59cfe788b4 req-ee68b869-732f-415d-9969-d28f1144c241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f81d5946-7c48-488c-b6b1-ed198857128f", "name": "network-vif-deleted", "tag": "31310b8b-ebdf-414b-9984-e3252a54c75e"}]} {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:05:36.070837 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:05:36.070837 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: warnings.warn(msg) Jan 31 05:05:36.079607 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-af9f6342-60c0-4d9a-accb-0e59cfe788b4 req-ee68b869-732f-415d-9969-d28f1144c241 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:36.080046 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [req-af9f6342-60c0-4d9a-accb-0e59cfe788b4 req-ee68b869-732f-415d-9969-d28f1144c241 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:36.090427 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e70ac75-9570-4dc3-9fe0-2d167b3c63be] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 38826. Jan 31 05:05:36.093096 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.compute.server_external_events [req-af9f6342-60c0-4d9a-accb-0e59cfe788b4 req-ee68b869-732f-415d-9969-d28f1144c241 service nova] Creating event network-vif-deleted:31310b8b-ebdf-414b-9984-e3252a54c75e for instance f81d5946-7c48-488c-b6b1-ed198857128f on hv-cinder-82660 Jan 31 05:05:36.097875 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [req-af9f6342-60c0-4d9a-accb-0e59cfe788b4 req-ee68b869-732f-415d-9969-d28f1144c241 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Jan 31 05:05:36.098425 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 610/1229] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:05:36.250322 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-debaa167-4ad9-4909-8b67-576c9973aae0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:36.250884 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-debaa167-4ad9-4909-8b67-576c9973aae0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:36.257190 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-debaa167-4ad9-4909-8b67-576c9973aae0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:36.257632 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-debaa167-4ad9-4909-8b67-576c9973aae0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:36.258403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-debaa167-4ad9-4909-8b67-576c9973aae0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:36.258860 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-debaa167-4ad9-4909-8b67-576c9973aae0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:36.323143 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-debaa167-4ad9-4909-8b67-576c9973aae0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:05:36.331570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-debaa167-4ad9-4909-8b67-576c9973aae0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1226 microversion: 2.1 time: 0.085373 Jan 31 05:05:36.332144 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 620/1230] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:36 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:05:37.350228 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:37.350844 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:37.357414 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:37.357849 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:37.358898 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:37.359329 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:37.394120 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:37.394564 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:37.395078 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.objects.instance [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lazy-loading 'fault' on Instance uuid f81d5946-7c48-488c-b6b1-ed198857128f {{(pid=123367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 05:05:37.436257 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:05:37.442722 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-cf274c78-614f-42e3-96f2-16646ef4c7d7 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 200 len: 1185 microversion: 2.1 time: 0.096966 Jan 31 05:05:37.446909 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 611/1231] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:37 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:05:38.459917 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:38.460575 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: f81d5946-7c48-488c-b6b1-ed198857128f] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:38.467900 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:38.468338 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:38.469332 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:38.469762 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:38.488456 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] HTTP exception thrown: Instance f81d5946-7c48-488c-b6b1-ed198857128f could not be found. Jan 31 05:05:38.489072 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Returning 404 to user: Instance f81d5946-7c48-488c-b6b1-ed198857128f could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 05:05:38.489838 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-515a996c-22d1-42f1-982e-4913cf5f6b3e tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f" status: 404 len: 111 microversion: 2.1 time: 0.033615 Jan 31 05:05:38.490377 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 621/1232] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:38 2022] GET /compute/v2.1/servers/f81d5946-7c48-488c-b6b1-ed198857128f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 05:05:41.783898 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-8a7238aa-d3db-421a-ad3d-2fd5f019f435 req-52151744-a9c7-47c3-91ef-6e5d7423ba11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c", "tag": "67da84bc-ecc7-4515-833e-0b8f7bdae679"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:05:41.785409 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:05:41.785409 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 05:05:41.789650 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-ce68cb0e-c0c7-429e-a64d-9d1b8a3be42c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:41.790146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ce68cb0e-c0c7-429e-a64d-9d1b8a3be42c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:41.797580 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ce68cb0e-c0c7-429e-a64d-9d1b8a3be42c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:41.798032 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ce68cb0e-c0c7-429e-a64d-9d1b8a3be42c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:41.799207 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ce68cb0e-c0c7-429e-a64d-9d1b8a3be42c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:41.799327 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-ce68cb0e-c0c7-429e-a64d-9d1b8a3be42c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:41.799993 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-8a7238aa-d3db-421a-ad3d-2fd5f019f435 req-52151744-a9c7-47c3-91ef-6e5d7423ba11 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:41.800429 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-8a7238aa-d3db-421a-ad3d-2fd5f019f435 req-52151744-a9c7-47c3-91ef-6e5d7423ba11 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:41.812114 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-8a7238aa-d3db-421a-ad3d-2fd5f019f435 req-52151744-a9c7-47c3-91ef-6e5d7423ba11 service nova] Creating event network-changed:67da84bc-ecc7-4515-833e-0b8f7bdae679 for instance 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c on hv-cinder-82660 Jan 31 05:05:41.817403 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-8a7238aa-d3db-421a-ad3d-2fd5f019f435 req-52151744-a9c7-47c3-91ef-6e5d7423ba11 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036995 Jan 31 05:05:41.818570 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 622/1233] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:05:41.826419 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-ce68cb0e-c0c7-429e-a64d-9d1b8a3be42c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Going to try to terminate instance {{(pid=123367) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 05:05:42.141220 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-ce68cb0e-c0c7-429e-a64d-9d1b8a3be42c tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 204 len: 0 microversion: 2.1 time: 0.363108 Jan 31 05:05:42.141795 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 612/1234] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 05:05:41 2022] DELETE /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 05:05:42.152495 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-4e5cbadd-c6e4-429f-a5ef-0721db22b983 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:42.156697 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-4e5cbadd-c6e4-429f-a5ef-0721db22b983 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:42.162150 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4e5cbadd-c6e4-429f-a5ef-0721db22b983 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:42.162588 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4e5cbadd-c6e4-429f-a5ef-0721db22b983 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:42.163401 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4e5cbadd-c6e4-429f-a5ef-0721db22b983 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:42.163979 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-4e5cbadd-c6e4-429f-a5ef-0721db22b983 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:42.306007 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-4e5cbadd-c6e4-429f-a5ef-0721db22b983 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:05:42.314947 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-4e5cbadd-c6e4-429f-a5ef-0721db22b983 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1576 microversion: 2.1 time: 0.168442 Jan 31 05:05:42.318606 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 623/1235] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:42 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:05:43.333003 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e29dce90-f735-4a63-a028-3e76da88593f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:43.333730 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e29dce90-f735-4a63-a028-3e76da88593f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:43.339986 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29dce90-f735-4a63-a028-3e76da88593f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:43.340372 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29dce90-f735-4a63-a028-3e76da88593f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:43.341136 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29dce90-f735-4a63-a028-3e76da88593f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:43.341567 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e29dce90-f735-4a63-a028-3e76da88593f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:43.488449 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e29dce90-f735-4a63-a028-3e76da88593f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:05:43.492357 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e29dce90-f735-4a63-a028-3e76da88593f tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1457 microversion: 2.1 time: 0.163250 Jan 31 05:05:43.492927 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 613/1236] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:43 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1457 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:05:44.449946 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [req-b8a19cea-1708-42e3-90a4-7844abc4879c req-e0b73a28-7792-4657-a69b-aa17296effc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c", "name": "network-vif-deleted", "tag": "67da84bc-ecc7-4515-833e-0b8f7bdae679"}]} {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 05:05:44.451699 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 05:05:44.451699 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: warnings.warn(msg) Jan 31 05:05:44.458754 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-b8a19cea-1708-42e3-90a4-7844abc4879c req-e0b73a28-7792-4657-a69b-aa17296effc3 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:44.459217 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [req-b8a19cea-1708-42e3-90a4-7844abc4879c req-e0b73a28-7792-4657-a69b-aa17296effc3 service nova] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:44.470534 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.compute.server_external_events [req-b8a19cea-1708-42e3-90a4-7844abc4879c req-e0b73a28-7792-4657-a69b-aa17296effc3 service nova] Creating event network-vif-deleted:67da84bc-ecc7-4515-833e-0b8f7bdae679 for instance 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c on hv-cinder-82660 Jan 31 05:05:44.475732 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [req-b8a19cea-1708-42e3-90a4-7844abc4879c req-e0b73a28-7792-4657-a69b-aa17296effc3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029357 Jan 31 05:05:44.476415 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 624/1237] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Jan 31 05:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 05:05:44.509063 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-e228ca69-b0cb-490e-ba0c-15f238d0e422 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:44.509760 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-e228ca69-b0cb-490e-ba0c-15f238d0e422 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:44.517061 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e228ca69-b0cb-490e-ba0c-15f238d0e422 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:44.519051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e228ca69-b0cb-490e-ba0c-15f238d0e422 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:44.519051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e228ca69-b0cb-490e-ba0c-15f238d0e422 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:44.519051 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-e228ca69-b0cb-490e-ba0c-15f238d0e422 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:44.581099 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.policy [None req-e228ca69-b0cb-490e-ba0c-15f238d0e422 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123367) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:05:44.588883 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-e228ca69-b0cb-490e-ba0c-15f238d0e422 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1391 microversion: 2.1 time: 0.083381 Jan 31 05:05:44.589479 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 614/1238] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:44 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1391 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:05:45.608275 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:45.609016 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:45.615540 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:45.616038 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:45.616751 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:45.617175 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:45.647766 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:45.648209 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:45.648646 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.objects.instance [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lazy-loading 'fault' on Instance uuid 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c {{(pid=123368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 05:05:45.691569 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.policy [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaad1042b434b5a8ff8f3a0acc585ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3ab219d9f44e1ab973f1d63347066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123368) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 05:05:45.698098 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-544c622d-88db-45a1-8bd5-6ce2d78a6380 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 200 len: 1185 microversion: 2.1 time: 0.095169 Jan 31 05:05:45.698659 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 625/1239] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:45 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 1185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 05:05:46.715127 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:46.715762 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:46.722190 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:46.722640 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:46.723448 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:46.723885 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:46.736818 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] HTTP exception thrown: Instance 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c could not be found. Jan 31 05:05:46.737371 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Returning 404 to user: Instance 4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 05:05:46.738167 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-f53ded3b-f091-4182-80d1-23a6d81258cc tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c" status: 404 len: 111 microversion: 2.1 time: 0.026732 Jan 31 05:05:46.738674 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 615/1240] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:46 2022] GET /compute/v2.1/servers/4e02b2f9-a0c0-4517-91d6-2a1dc547ec3c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 05:05:47.245389 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:47.245895 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.compute.api [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123368) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:47.252690 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:47.253370 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:47.254203 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:47.254901 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG oslo_concurrency.lockutils [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:47.268475 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.wsgi [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] HTTP exception thrown: Instance 136c717e-248a-4393-9e3b-4703b87f5ddb could not be found. Jan 31 05:05:47.269051 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Returning 404 to user: Instance 136c717e-248a-4393-9e3b-4703b87f5ddb could not be found. {{(pid=123368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 05:05:47.269850 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-a08cf6c7-40b3-4bdb-b8ec-e9e4eb703127 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "DELETE /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 404 len: 111 microversion: 2.1 time: 0.028136 Jan 31 05:05:47.270548 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 626/1241] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Jan 31 05:05:47 2022] DELETE /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 05:05:47.278509 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '>' {{(pid=123367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:47.279146 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.compute.api [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] [instance: 136c717e-248a-4393-9e3b-4703b87f5ddb] Fetching instance by UUID {{(pid=123367) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 05:05:47.285162 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:47.285600 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:47.286355 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 05:05:47.286785 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG oslo_concurrency.lockutils [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Lock "9cd4eb8b-132b-4c9f-8742-400a5e8dfa8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 05:05:47.299930 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.wsgi [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] HTTP exception thrown: Instance 136c717e-248a-4393-9e3b-4703b87f5ddb could not be found. Jan 31 05:05:47.300499 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: DEBUG nova.api.openstack.wsgi [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Returning 404 to user: Instance 136c717e-248a-4393-9e3b-4703b87f5ddb could not be found. {{(pid=123367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 05:05:47.301290 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO nova.api.openstack.requestlog [None req-918e4d06-ab41-48fe-b0cf-14c72d61cc82 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb" status: 404 len: 111 microversion: 2.1 time: 0.026366 Jan 31 05:05:47.301802 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: [pid: 123367|app: 0|req: 616/1242] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Jan 31 05:05:47 2022] GET /compute/v2.1/servers/136c717e-248a-4393-9e3b-4703b87f5ddb => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 05:05:48.722163 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: DEBUG nova.api.openstack.wsgi [None req-045be228-a759-45be-998a-41eed92fb5f0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] Calling method '.version_select at 0x7f69f4d22d30>' {{(pid=123368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 05:05:48.792611 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO nova.api.openstack.requestlog [None req-045be228-a759-45be-998a-41eed92fb5f0 tempest-TestVolumeBootPattern-574629423 tempest-TestVolumeBootPattern-574629423-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2002478922" status: 202 len: 0 microversion: 2.1 time: 0.074046 Jan 31 05:05:48.793180 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: [pid: 123368|app: 0|req: 627/1243] 10.222.0.21 () {58 vars in 1262 bytes} [Mon Jan 31 05:05:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2002478922 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 05:05:59.453983 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:05:59.454579 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: Mon Jan 31 05:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:07:07.770468 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:07:07.771023 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 05:07:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:08:46.912108 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:08:46.912584 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: Mon Jan 31 05:08:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:08:52.992149 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:08:52.992624 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 05:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:09:19.461867 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:09:19.464719 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: Mon Jan 31 05:09:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:10:27.778469 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:10:27.779099 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 05:10:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:10:56.574251 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:10:56.575044 dv-cinder-826608-2-iscsi devstack@n-api.service[123368]: Mon Jan 31 05:10:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 05:11:15.447138 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 05:11:15.448303 dv-cinder-826608-2-iscsi devstack@n-api.service[123367]: Mon Jan 31 05:11:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!